Display controller, display device, image processing method, and image processing program for a multiple viewpoint display

ABSTRACT

To overcome issues generated due to the light-shield part in a display device which displays different images towards a plurality of viewpoints, and to provide a device for easily synthesizing images to be displayed on a display part. A display controller includes: an image memory which stores viewpoint image data for a plurality of viewpoints; a writing control device which writes the viewpoint image data inputted from outside to the image memory; a parameter storage device which stores parameters showing a positional relation between a lenticular lens and the display part; and a readout control device which reads out the viewpoint image data from the image memory according to a readout order obtained by applying the parameters to a repeating regulation that is determined based on layout of the sub-pixels, number of colors, and layout of the colors, and outputs it to the display module as synthesized image data.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based upon and claims the benefit of priority fromJapanese patent application No. 2009-099340, filed on Apr. 15, 2009,Japanese patent application No. 2010-067645, filed on Mar. 24, 2010 andJapanese patent application No. 2010-067646, filed on Mar. 24, 2010, thedisclosure of which is incorporated herein in its entirety by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a device for displaying differentimages to a plurality of viewpoints and to a signal processing method ofimage data to be displayed. More specifically, the present inventionrelates to a structure of a display part capable of providinghigh-quality display images, an image data processing device fortransmitting image data for each viewpoint to the display part, and animage data processing method.

2. Description of the Related Art

In accordance with developments in portable telephones and PDAs(personal digital assistants), more and more size reduction and higherdefinition of the display devices have been achieved. In the meantime,as a display device with a new added values, a display device with whichdifferent images are viewed depending on the positions from whichviewers observe the display device, i.e., a display device whichprovides different image to a plurality of viewpoints, and a displaydevice which provides three-dimensional images to the viewer by makingthe different image as parallax images have attracted attentions.

As a method which provides different images to a plurality ofviewpoints, there is known a method which synthesizes and displays imagedata for each of the viewpoints, separates the displayed synthesizedimage by an optical separating device formed with a barrier(light-shielding plate) having a lens or a slit, and provides the imagesto each of the viewpoints. The principle of image separation is to limitthe pixels observed from each viewing direction by using an opticaldevice such as a barrier having a slit or a lens. As the imageseparating device, generally used are a parallax barrier formed with abarrier having a great number of slits in stripes, and a lenticular lensin which cylindrical lenses exhibiting a lens effect in one directionare arranged.

There has been proposed a stereoscopic display device or amulti-viewpoint display device, which includes an optical imageseparating device such as the one described above and a device whichgenerates synthesized images to be displayed from the image data foreach viewpoint (see Japanese Unexamined Patent Publication 2008-109607(Patent Document 1), for example). Patent Document 1 discloses: adisplay device which performs stereoscopic display by using a liquidcrystal panel and a parallax barrier; and a synthesizing method forcreating synthesized images to be displayed on a display part (liquidcrystal panel) when performing the stereoscopic display. In this liquidcrystal panel, pixel electrodes that form a plurality of sub-pixels arearranged in matrix in the horizontal direction and the verticaldirection on the display part. At boundaries between each of the pixelelectrodes, scanning lines are provided in the horizontal direction anddata lines are provided in the vertical direction. Further, TFTs (thinfilm transistors) as pixel switching elements are provided in thevicinity of intersection points between the scanning lines and the datalines.

With the stereoscopic display device using the optical image separatingdevice, it is unnecessary for users to wear special eyeglasses. Thus, itis suited to be loaded on portable devices because there is notroublesome work of wearing the eyeglasses. Actually, portable devicesto which a stereoscopic display device formed with a liquid crystalpanel and a parallax barrier is loaded have been manufactured asproducts on the market (see NIKKEI ELECTRONICS, Jan. 6, 2003, No. 838pp. 26-27 (Non-Patent Document 1), for example).

With the above method, i.e., with the display device which providesdifferent images to each of a plurality of viewpoints by using theoptical separating device, there may be cases where the boundary betweenan image and another image is observed dark when the observer changesthe viewing position and the image to be observed becomes changed. Thisphenomenon is caused because a non-display region (a light-shield partgenerally called a black matrix in liquid crystal panel) between theimage and another image for each viewpoint is observed. Theabove-described phenomenon generated due to the change in the observer'sviewing point does not occur in a general display device which does nothave an optical separating device. Thus, the observers feel a sense ofdiscomfort or deterioration in the display quality when encountering theabove-described phenomenon which is generated in a multi-viewpointdisplay device or a stereoscopic display device having the opticalseparating device.

In order to improve the issues generated due to the optical separatingdevice and the light-shield part described above, there is proposed adisplay device which suppresses deterioration in the display qualitythrough devising the shape and the layout of the pixel electrodes andthe light-shield part of the display part (Japanese Unexamined PatentPublication 2005-208567 (Patent Document 2), Japanese Unexamined PatentPublication 2009-098311 (Patent Document 3), for example).

FIG. 134 is a plan view showing a display part of a display devicedisclosed in Patent Document 2. An aperture part 75 shown in FIG. 134 isan aperture part of a sub-pixel that is the minimum unit of imagedisplay. The layout direction of the aperture part 75 in vertical andlateral directions are defined as a vertical direction 11 and ahorizontal direction 12, respectively, as shown in FIG. 134. The shapeof each aperture part 75 is substantially a trapezoid having featureswhich will be described later. Further, the image separating device is alenticular lens in which cylindrical lenses 30 a having the verticaldirection 11 as the longitudinal direction thereof are arranged in thehorizontal direction 12. The cylindrical lens 30 a does not exhibit thelens effect in the longitudinal direction but exhibits the lens effectonly in the lateral direction. That is, the lens effect is achieved forthe horizontal direction 12. Thus, light that exits from the apertureparts 75 of a sub-pixel 41 and a sub-pixel 42 neighboring in thehorizontal direction 12 is directed towards different directions fromeach other.

In the aperture part 75, there are a pair of sides which slope towardsopposite direction from each other with respect to the verticaldirection 11 and the angles thereof between the vertical direction 11and the extending directions are the same. As a result, along thehorizontal direction 12, the position of an edge part of the aperturepart 75 of the display panel and the position of the optical axis of thecylindrical lens 30 a are relatively different in the vertical direction11. Further, the aperture parts 75 neighboring to each other along thelongitudinal direction are arranged to be line-symmetrical with respectto a segment extending in the lateral direction 12. Furthermore, theaperture parts 75 neighboring to each other along the horizontaldirection 12 are arranged to be point-symmetrical with respect to anintersection point between a segment that connects the middle pointbetween the both edges in the vertical direction 11 and a segment thatconnects the middle point between the both edges in the horizontaldirection 12.

Therefore, regarding the aperture widths in the vertical direction 11,the total widths of the aperture part 75 of the sub-pixel 41 and theaperture part 75 of the sub-pixel 42 in the slope parts aresubstantially constant regardless of the positions in the horizontaldirection 12.

That is, in the display device depicted in Patent Document 2, whensectional view of a display panel is assumed in the vertical direction11 that is perpendicular with respect to the arranging direction of thecylindrical lenses 30 a at an arbitrary point along the horizontaldirection 12, the proportions of the light-shield parts (wirings 70 andlight-shield parts 76) and the aperture parts are substantially thesame. Thus, when the observer moves the viewing point to the lateraldirection 12 that is the image separating direction so that theobserving direction is changed, the proportions of the light-shieldparts to be observed are substantially the same. That is, the observerdoes not observe only the light-shield parts from a specific direction,so that the display is not to be observed dark. That is, it is possibleto prevent deterioration in the display quality that is caused due tothe light-shield regions.

However, there are following issues with the related techniquesdescribed above. With the display device depicted in Patent Document 1,deterioration in the display quality caused due to the light-shieldparts is an issue, as described above.

The display device depicted in Patent Document 2 which manages toovercome the issue caused due to the light-shield part needs to keep acomplicated relation between the aperture shape of the pixel electrodesof the sub-pixels and the shape of the light-shield parts. Thus, theswitching devices (TFTs) to be the light-shield parts cannot be arrangedat uniform positions with a pixel electrode unit, such as in thevicinity of the intersection points between the scanning lines and thedata lines, unlike the case of Patent Document 1. Further, with thedisplay part of the display device, it is required to have minute pixelpitch for improving the definition and to increase the so-callednumerical aperture that is determined with an area ratio of the apertureparts and the light-shield parts which contribute to the displayluminance for improving the display luminance. In order to achieve thehigh numerical aperture while keeping the light-shield part shape andthe aperture shape of the display part depicted in Patent Document 2,not only the arranging positions of the switching devices but also theconnecting relations between the switching devices and the scanninglines as well as the data lines cannot be determined uniformly with thepixel electrode unit, unlike the case of Patent Document 1. To havenonuniform connecting relations regarding the switching devices of thepixel electrodes, the scanning lines, and the data lines in the pixelelectrode unit means that a typical method for generating thesynthesized image as depicted in Patent Document 1 cannot be employed.

The present invention has been designed in view of the aforementionedissues. It is an exemplary object of the present invention to provide: adisplay device capable of displaying images to each of a plurality ofviewpoints, which includes a display part in which the shape and layoutof the sub-pixels capable of suppressing the issues caused due to thelight-shield parts are maintained, and layout and connections of thepixel electrodes, the switching devices, the scanning lines, the datalines, and the like are designed to achieve the high numerical aperture;a display controller of the display device; a device for generatingsynthesized images to be displayed on the display part; and a method forgenerating the synthesized images.

SUMMARY OF THE INVENTION

A display controller according to an exemplary aspect of the inventionis a controller for outputting synthesized image data to a displaymodule which includes: a display part in which sub-pixels connected todata lines via switching devices controlled by scanning lines arearranged in m-rows and n-columns (m and n are natural numbers), which isdriven by (m+1) pieces of the scanning lines and at least n pieces ofthe data lines; and a first image separating device which directs lightemitted from the sub-pixels towards a plurality of viewpoints in asub-pixel unit. The display controller includes: an image memory whichstores viewpoint image data for the plurality of viewpoints; a writingcontrol device which writes the viewpoint image data inputted fromoutside to the image memory; a parameter storage device which storesparameters showing a positional relation between the first imageseparating device and the display part; and a readout control devicewhich reads out the viewpoint image data from the image memory accordingto a readout order that is obtained by applying the parameters to arepeating regulation that is determined based on layout of thesub-pixels, number of colors, and layout of the colors, and outputs thereadout data to the display module as the synthesized image data.

A display controller according to another exemplary aspect of theinvention is a controller for outputting synthesized image data to adisplay module which includes: a display part in which sub-pixelsconnected to data lines via switching devices controlled by scanninglines are arranged in n-rows and m-columns (m and n are naturalnumbers), which is driven by (n+1) pieces of data lines and (m+1) piecesof the scanning lines; and an image separating device which directslight emitted from the sub-pixels towards a plurality of viewpoints inan extending direction of the data lines in a sub-pixel unit. Thedisplay controller includes: an image memory which stores viewpointimage data for the plurality of viewpoints; a writing control devicewhich writes the viewpoint image data inputted from outside to the imagememory; and a readout control device which reads out the viewpoint imagedata from the image memory according to a readout order corresponding tothe display module, and outputs the readout data to the display moduleas the synthesized image data.

An image processing method according to still another exemplary aspectof the invention is a method for generating synthesized image data to beoutputted to a display module which includes: a display part in whichsub-pixels connected to data lines via switching devices controlled byscanning lines are arranged in m-rows and n-columns (m and n are naturalnumbers), which is driven by (m+1) pieces of the scanning lines and atleast n pieces of the data lines; and a first image separating devicewhich directs light emitted from the sub-pixels towards a plurality ofviewpoints in a sub-pixel unit. The method includes: reading parametersshowing a positional relation between the first image separating deviceand the display part from a parameter storage device; inputtingviewpoint image data for a plurality of viewpoints from outside, andwriting the data into the image memory; and reading out the viewpointimage data from the image memory according to a readout order that isobtained by applying the parameters to a repeating regulation that isdetermined based on layout of the sub-pixels, number of colors, andlayout of the colors, and outputting the readout data to the displaymodule as the synthesized image data.

An image processing method according to still another exemplary aspectof the invention is a method for generating synthesized image data to beoutputted to a display module which includes: a display part in whichsub-pixels connected to data lines via switching devices controlled byscanning lines are arranged in n-rows and m-columns (m and n are naturalnumbers), which is driven by (n+1) pieces of data lines and (m+1) piecesof the scanning lines; and an image separating device which directslight emitted from the sub-pixels towards a plurality of viewpoints inan extending direction of the data lines in a sub-pixel unit. The imageprocessing method includes: inputting viewpoint image data for theplurality of viewpoints from outside, and writing the data into an imagememory; reading out the viewpoint image data from the image memoryaccording to a readout order corresponding to the display module; andoutputting the readout viewpoint image data to the display module as thesynthesized image data.

An image processing program according to still another exemplary aspectof the invention is a program for generating synthesized image data tobe outputted to a display module which includes: a display part in whichsub-pixels connected to data lines via switching devices controlled byscanning lines are arranged in m-rows and n-columns (m and n are naturalnumbers), which is driven by (m+1) pieces of the scanning lines and atleast n pieces of the data lines; and a first image separating devicewhich directs light emitted from the sub-pixels towards a plurality ofviewpoints in a sub-pixel unit. The program causes a computer toexecute: a procedure for reading parameters showing a positionalrelation between the first image separating device and the display partfrom a parameter storage device; a procedure for inputting viewpointimage data for a plurality of viewpoints from outside, and writing thedata into the image memory; and a procedure for reading out theviewpoint image data from the image memory according to a readout orderthat is obtained by applying the parameters to a repeating regulationthat is determined based on layout of the sub-pixels, number of colors,and layout of the colors, and outputting the readout data to the displaymodule as the synthesized image data.

An image processing program according to still another exemplary aspectof the invention is a program for generating synthesized image data tobe outputted to a display module which includes: a display part in whichsub-pixels connected to data lines via switching devices controlled byscanning lines are arranged in n-rows and m-columns (m and n are naturalnumbers), which is driven by (n+1) pieces of data lines and (m+1) piecesof the scanning lines; and an image separating device which directslight emitted from the sub-pixels towards a plurality of viewpoints inan extending direction of the data lines in a sub-pixel unit. The imageprocessing program causes a computer to execute: a procedure forinputting viewpoint image data for the plurality of viewpoints fromoutside, and writing the data into an image memory; a procedure forreading out the viewpoint image data from the image memory according toa readout order corresponding to the display module; and a procedure foroutputting the readout viewpoint image data to the display module as thesynthesized image data.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic block diagram of a first exemplary embodimentaccording to the present invention;

FIG. 2 is a functional block diagram of the first exemplary embodimentaccording to the present invention;

FIG. 3 is a top plan view showing four sub-pixels of the first exemplaryembodiment according to the present invention;

FIG. 4 shows the structure of an up-and-down sub-pixel pair P2R andequivalent circuits according to the present invention;

FIG. 5 shows the structure of an up-and-down sub-pixel pair P2L andequivalent circuits according to the present invention;

FIG. 6 shows input image data according to the first exemplaryembodiment of the present invention;

FIG. 7 shows a first example of layout of an image separating deviceaccording to the first exemplary embodiment of the present invention;

FIG. 8 shows a layout pattern 1 of a display part according to the firstexemplary embodiment of the present invention;

FIG. 9 shows a layout pattern 2 of the display part according to thefirst exemplary embodiment of the present invention;

FIG. 10 shows a layout pattern 3 of the display part according to thefirst exemplary embodiment of the present invention;

FIG. 11 shows a layout pattern 4 of the display part according to thefirst exemplary embodiment of the present invention;

FIG. 12 shows polarity distributions of gate line inversion drive in thelayout pattern 2 of the first exemplary embodiment according to thepresent invention;

FIG. 13 shows polarity distributions of gate 2-line inversion drive inthe layout pattern 2 of the first exemplary embodiment according to thepresent invention;

FIG. 14 shows polarity distributions of dot inversion drive in thelayout pattern 2 of the first exemplary embodiment according to thepresent invention;

FIG. 15 shows polarity distributions of dot inversion drive in thelayout pattern 3 of the first exemplary embodiment according to thepresent invention;

FIG. 16 shows polarity distributions of vertical 2-dot inversion drivein the layout pattern 4 of the first exemplary embodiment according tothe present invention;

FIG. 17 shows a layout pattern 5 of the display part according to thefirst exemplary embodiment of the present invention;

FIG. 18 shows synthesized image data 1 according to the first exemplaryembodiment of the present invention (layout pattern 1);

FIG. 19 shows synthesized image data 2 according to the first exemplaryembodiment of the present invention (layout pattern 2);

FIG. 20 shows synthesized image data 3 according to the first exemplaryembodiment of the present invention (layout pattern 3);

FIG. 21 shows synthesized image data 4 according to the first exemplaryembodiment of the present invention (layout pattern 4);

FIG. 22 shows synthesized image data 5 according to the first exemplaryembodiment of the present invention (layout pattern 5);

FIG. 23 shows a second example of the layout of the image separatingdevice according to the first exemplary embodiment of the presentinvention;

FIG. 24 shows even/odd of scanning lines and viewpoint images in thefirst exemplary embodiment of the present invention;

FIG. 25 shows the regularity of scanning line unit according to thefirst exemplary embodiment of the present invention;

FIG. 26 shows even/odd of the scanning lines and the use state of thedata lines according to the first exemplary embodiment of the presentinvention;

FIG. 27 shows an example of a lookup table for storing the layoutpattern of the first exemplary embodiment according to the presentinvention;

FIG. 28 shows an example of a lookup table for storing the layoutpattern of the first exemplary embodiment according to the presentinvention;

FIG. 29 shows saved parameters of the first exemplary embodimentaccording to the present invention;

FIG. 30 shows a flowchart of the first exemplary embodiment according tothe present invention;

FIG. 31 shows a flowchart of the first exemplary embodiment according tothe present invention;

FIG. 32 shows a flowchart of the first exemplary embodiment according tothe present invention;

FIG. 33 shows a flowchart of the first exemplary embodiment according tothe present invention;

FIG. 34 shows a flowchart of the first exemplary embodiment according tothe present invention;

FIG. 35 shows a flowchart of the first exemplary embodiment according tothe present invention;

FIG. 36 shows a flowchart of the first exemplary embodiment according tothe present invention;

FIG. 37 is a block diagram of a terminal device as an example to whichthe display device of the present invention is applied;

FIG. 38 shows an example of layout of an image separating deviceaccording to a second exemplary embodiment of the present invention;

FIG. 39 is an optical model according to the second exemplary embodimentof the present invention;

FIG. 40 shows a layout pattern 6 of a display part according to thesecond exemplary embodiment of the present invention;

FIG. 41 shows polarity distributions of vertical 2-dot inversion drivein the layout pattern 6 of the second exemplary embodiment according tothe present invention;

FIG. 42 shows input image data according to the second exemplaryembodiment of the present invention;

FIG. 43 shows synthesized image data 6 according to the second exemplaryembodiment of the present invention (layout pattern 6);

FIG. 44 is a functional block diagram of the second exemplary embodimentaccording to the present invention;

FIG. 45 is an illustration showing rearrangement of input data accordingto the second exemplary embodiment of the present invention;

FIG. 46 is a functional block diagram of a third exemplary embodimentaccording to the present invention;

FIG. 47 shows layout of an image separating device according to a fourthexemplary embodiment of the present invention;

FIG. 48 is a functional block diagram of the fourth exemplary embodimentaccording to the present invention;

FIG. 49 is an illustration for describing vertical-lateral conversion(flat display) according to the fourth exemplary embodiment;

FIG. 50 is an illustration for describing vertical-lateral conversion(stereoscopic display) according to the fourth exemplary embodiment;

FIG. 51 is a functional block diagram of a fifth exemplary embodimentaccording to the present invention;

FIG. 52 is a timing chart showing a first example of actions of thefifth exemplary embodiment of the present invention;

FIG. 53 is an explanatory diagram of dot-by-dot data transfer used inthe present invention;

FIG. 54 is a timing chart showing a second example of actions of thefifth exemplary embodiment of the present invention;

FIG. 55 is a functional block diagram of a sixth exemplary embodimentaccording to the present invention;

FIG. 56 is a timing chart showing actions of the sixth exemplaryembodiment of the present invention;

FIG. 57 shows an example of input image data according to the fifthexemplary embodiment to an eighth exemplary embodiment of the presentinvention;

FIG. 58 is a functional block diagram of a seventh exemplary embodimentaccording to the present invention;

FIG. 59 is a timing chart showing actions of the seventh exemplaryembodiment of the present invention;

FIG. 60 is an illustration showing corresponding relations between inputdata and sub-pixels of the display part according to the presentinvention;

FIG. 61 is a functional block diagram of an eighth exemplary embodimentaccording to the present invention;

FIG. 62 is a timing chart showing actions of the eighth exemplaryembodiment of the present invention;

FIG. 63 is a functional block diagram showing a ninth exemplaryembodiment;

FIG. 64 is a schematic block diagram showing the ninth exemplaryembodiment;

FIG. 65 is a plan view showing a first example of the structure of foursub-pixels which configure a part (2 rows and 2 columns) of a displaypart according to the ninth exemplary embodiment;

FIG. 66 is an explanatory diagram showing the arranging direction ofdata lines on the display part of the ninth exemplary embodiment;

FIG. 67 shows a plan view which illustrates a first example of thestructure of an up-and-down sub-pixel pair P2R according to the ninthexemplary embodiment, and shows circuit diagrams of equivalent circuit1;

FIG. 68 shows a plan view which illustrates a first example of thestructure of an up-and-down sub-pixel pair P2L according to the ninthexemplary embodiment, and shows circuit diagrams of equivalent circuit1;

FIG. 69 shows charts showing input image data of the ninth exemplaryembodiment;

FIG. 70 is a schematic plan view showing a first example of the imageseparating device layout and the color layout relation according to theninth exemplary embodiment;

FIG. 71 is a schematic plan view showing a layout pattern 1 of thedisplay part according to the ninth exemplary embodiment;

FIG. 72 is a schematic plan view showing a layout pattern 2 of thedisplay part according to the ninth exemplary embodiment;

FIG. 73 is a schematic plan view showing a layout pattern 3 of thedisplay part according to the ninth exemplary embodiment;

FIG. 74 shows charts showing a polarity distribution when gate lineinversion drive is employed to the display part (layout pattern 2);

FIG. 75 shows charts showing a polarity distribution when dot inversiondrive is employed to the display part (layout pattern 2);

FIG. 76 shows charts showing a polarity distribution when dot inversiondrive is employed to the display part (layout pattern 3);

FIG. 77 is a schematic plan view showing a layout pattern 4 of thedisplay part according to the ninth exemplary embodiment;

FIG. 78 is a chart showing synthesized image data 1 which is outputtedto the display part of the layout pattern 1 of the ninth exemplaryembodiment;

FIG. 79 is a chart showing synthesized image data 2 which is outputtedto the display part of the layout pattern 2 of the ninth exemplaryembodiment;

FIG. 80 is a chart showing synthesized image data 3 which is outputtedto the display part of the layout pattern 3 of the ninth exemplaryembodiment;

FIG. 81 is a chart showing synthesized image data 4 which is outputtedto the display part of the layout pattern 4 of the ninth exemplaryembodiment;

FIG. 82 is a schematic plan view showing a second example of the imageseparating device layout and the color layout relation according to theninth exemplary embodiment;

FIG. 83 is a chart showing the relation between viewpoints of inputimage data and even/odd of data lines on the display part according tothe ninth exemplary embodiment;

FIG. 84 is a chart showing the relation between input image data anddata lines on the display part according to the ninth exemplaryembodiment;

FIG. 85 is a chart showing the relation between input image data andscanning lines on the display part according to the ninth exemplaryembodiment;

FIG. 86 is a chart showing the relation between column numbers of theinput image data and scanning lines on the display part according to theninth exemplary embodiment;

FIG. 87 is a chart showing the connecting information of the up-and-downsub-pixel pairs P2R and P2L in the layout pattern 3 of the ninthexemplary embodiment;

FIG. 88 shows charts showing an example of lookup table which stores thelayout pattern of the ninth exemplary embodiment;

FIG. 89 is a chart showing the relation regarding LUT (Dy, Gx), even/oddof scanning lines and data lines, and the facing directions of thesub-pixels according to the ninth exemplary embodiment;

FIG. 90 is a chart showing the relation between viewpoints of inputimage data and even/odd of data lines on the display part according tothe ninth exemplary embodiment;

FIG. 91 is a chart showing saved parameters required for generatingsynthesized image data according to the ninth exemplary embodiment;

FIG. 92 is a flowchart showing the outline of actions of the displaydevice according to the ninth exemplary embodiment executed for eachframe;

FIG. 93 shows the outline of synthesized image output processing of theninth exemplary embodiment, which is a flowchart mainly showing countprocessing in a unit of scanning line;

FIG. 94 shows the outline of line data output processing of the ninthexemplary embodiment, which is a flowchart mainly showing countprocessing in a unit of data line;

FIG. 95 is a flowchart showing the outline of readout and rearrangingprocessing of the ninth exemplary embodiment;

FIG. 96 shows a flowchart showing input data designation processing whencount value in a data line unit according to the ninth exemplaryembodiment is “s=1”;

FIG. 97 shows a flowchart showing input data designation processing whencount value in a data line unit according to the ninth exemplaryembodiment is “s=2”;

FIG. 98 shows a flowchart showing input data designation processing whencount value in a data line unit according to the ninth exemplaryembodiment is “s=3”;

FIG. 99 shows a flowchart showing input data designation processing whencount value in a data line unit according to the ninth exemplaryembodiment is “s=4”;

FIG. 100 shows a flowchart showing input data designation processingwhen count value in a data line unit according to the ninth exemplaryembodiment is “s=5”;

FIG. 101 shows a flowchart showing input data designation processingwhen count value in a data line unit according to the ninth exemplaryembodiment is “s=6”;

FIG. 102 is a block diagram showing a terminal device to which thedisplay device of the ninth exemplary embodiment is applied;

FIG. 103 shows a plan view which illustrates a second example of thestructure of the up-and-down sub-pixel pair P2R according to the ninthexemplary embodiment, and shows circuit diagrams of equivalent circuit2;

FIG. 104 shows a plan view which illustrates a second example of thestructure of the up-and-down sub-pixel pair P2L according to the ninthexemplary embodiment, and shows circuit diagrams of equivalent circuit2;

FIG. 105 shows charts showing a polarity distribution when 2-dotinversion drive is employed to the display part (layout pattern 2)according to the ninth exemplary embodiment;

FIG. 106 is a schematic plan view showing a layout pattern 6 of thedisplay part according to the ninth exemplary embodiment;

FIG. 107 shows charts showing a polarity distribution when 2-dotinversion drive is employed to the display part (layout pattern 6)according to the ninth exemplary embodiment;

FIG. 108 is a functional block diagram showing a tenth exemplaryembodiment;

FIG. 109 is a schematic plan view showing a example of the imageseparating device layout and an example of color layout according to thetenth exemplary embodiment;

FIG. 110 is an explanatory diagram showing an optical model of the tenthexemplary embodiment;

FIG. 111 is a schematic plan view showing a layout pattern 5 of thedisplay part according to the tenth exemplary embodiment;

FIG. 112 shows charts showing a polarity distribution when dot inversiondrive is employed to the display part (layout pattern 5) according tothe tenth exemplary embodiment;

FIG. 113 shows charts of input image data according to the tenthexemplary embodiment;

FIG. 114 is a chart showing synthesized image data 5 which is outputtedto the display part of the layout pattern 5 of the tenth exemplaryembodiment;

FIG. 115 is a chart showing an example of lookup table which stores thelayout pattern 5 of the tenth exemplary embodiment;

FIG. 116 shows charts showing an example of input image datarearrangement according to the tenth exemplary embodiment;

FIG. 117 is a schematic plan view showing a first example ofcorresponding relation between an image separating device and columnnumber of the display part according to the tenth exemplary embodiment;

FIG. 118 is a schematic plan view showing a second example ofcorresponding relation between the image separating device and columnnumber of the display part according to the tenth exemplary embodiment;

FIG. 119 is a chart showing an example of table TM which shows values ofviewpoint number k for the column numbers of the display part accordingto the tenth exemplary embodiment;

FIG. 120 is a chart showing the relation between even/odd of data linesand input synthesized data according to the tenth exemplary embodiment;

FIG. 121 is a flowchart showing the outline of actions executed in thedisplay device of the tenth exemplary embodiment;

FIG. 122 is a chart showing an example of input image data rearrangementexecuted in the display device of the tenth exemplary embodiment;

FIG. 123 is a functional block diagram showing an eleventh exemplaryembodiment;

FIG. 124 is an explanatory diagram showing an example of transform formof input image data according to the eleventh exemplary embodiment;

FIG. 125 is a timing chart showing an example of actions executed in theeleventh exemplary embodiment;

FIG. 126 is an explanatory diagram showing another example of thetransform form of input image data according to the eleventh exemplaryembodiment;

FIG. 127 is an explanatory diagram showing an example of transform formof input image data according to a twelfth exemplary embodiment;

FIG. 128 is a timing chart showing an example of actions executed in thetwelfth exemplary embodiment;

FIG. 129 is a schematic plan view showing a corresponding relationbetween the first column and the second column of a second viewpointimage data M2 shown in FIG. 69 and sub-pixels of the display panel inthe layout pattern shown in FIG. 71;

FIG. 130 is a schematic plan view showing a first example of a data-linedriving circuit and a display part according to a thirteenth exemplaryembodiment;

FIG. 131 is a timing chart showing an example of actions executed in thethirteenth exemplary embodiment;

FIG. 132 is a schematic plan view showing a second example of thedata-line driving circuit and the display part according to thethirteenth exemplary embodiment;

FIG. 133 is a schematic plan view showing a third example of thedata-line driving circuit and the display part according to thethirteenth exemplary embodiment; and

FIG. 134 is a plan view showing a display part of a display deviceaccording to a related technique.

DETAILED DESCRIPTION OF THE EXEMPLARY EMBODIMENTS

First, exemplary embodiments of the present invention will be describedfrom a first exemplary embodiment to an eighth exemplary embodiment.

Hereinafter, the exemplary embodiments of the present invention will bedescribed by referring to the accompanying drawings. In the followingexplanations of the first exemplary embodiment to the eighth exemplaryembodiment, it is to be noted that the arranging direction of scanninglines in a display panel is defined as “vertical direction” and thearranging direction of data lines is defined as “horizontal direction”.Further, a sequence of pixel electrodes along the vertical direction iscalled a “column”, a sequence of pixel electrodes along the horizontaldirection is called a “row”, and a pixel electrode matrix is expressedas “m-rows×n-columns”.

(First Exemplary Embodiment)

First, the outline of the first exemplary embodiment will be describedby mainly referring to FIG. 1 and FIG. 2. A display controller 100according to the embodiment outputs synthesized image data CM to adisplay module 200. The display module 200 includes a display part 50and a first image separating device (30). In the display part 50,sub-pixels 40 connected to data lines D1, - - - via switching devices(46: FIG. 3) controlled by scanning lines G1, - - - are arranged inm-rows and n-columns (m and n are natural numbers), and the sub-pixels40 are driven by (m+1) pieces of scanning lines G1, - - - and at least npieces of data lines D1, - - - . The first image separating device (30)directs the light emitted from the sub-pixels 40 to a plurality ofviewpoints by a unit of the sub-pixel 40. Further, the displaycontroller 100 includes: an image memory 120 which stores viewpointimage data for a plurality of viewpoints; a writing control device 110which writes the viewpoint image data inputted from outside to the imagememory 120; a parameter storage device 140 which stores parametersshowing a positional relation of the first image separating device (30)and the display part 50; and a readout control device 130 which readsout the viewpoint image data from the image memory 120 according to areadout order that is obtained by applying the parameters to a repeatingregulation that is determined based on the layout of the sub-pixels 40,number of colors, and layout of the colors, and outputs it to thedisplay module 200 as the synthesized image data CM. The first imageseparating device (30) corresponds to a lenticular lens 30, and theswitching device (46: FIG. 3) corresponds to a TFT 46.

The display part 50 is formed by having an up-and-down sub-pixel pairP2R (FIG. 4) or P2L (FIG. 5) configured with two sub-pixels 40 a, 40 barranged by sandwiching a single scanning line Gy as a basic unit. Theswitching devices (46) provided to each of the two sub-pixels 40 a, 40 bare controlled in common by the scanning line Gy sandwiched by the twosub-pixels 40 a, 40 b, and are connected to different data lines Dx,Dx+1. The up-and-down sub-pixel pairs P2R (FIG. 4) or P2L (FIG. 5)neighboring to each other in the extending direction of the scanningline Gy are so arranged that the switching devices (46) thereof arecontrolled by different scanning lines Gy−1, Gy+1.

More specifically, there are three colors of the sub-pixels 40 such as afirst color (R), a second color (G), and a third color (B). Providedthat “y” is a natural number, regarding the up-and-down sub-pixel pairP2R (FIG. 4) or P2L (FIG. 5) connected to the y-th scanning line Gy, thecolor of one of the two sub-pixels 40 a and 40 b is the first color (R)while the other is the second color (G), and forms either an even columnor an odd column of the display part 50. Regarding the up-and-downsub-pixel pair P2R (FIG. 4) or P2L (FIG. 5) connected to the (y+1)-thscanning line Gy+1, the color of one of the two sub-pixels 40 a and 40 bis the second color (G) while the other is the third color (B), andforms the other one of the even column or the odd column of the displayinit 50. Regarding the up-and-down sub-pixel pair P2R (FIG. 4) or P2L(FIG. 5) connected to the (y+2)-th scanning line Gy+2, the color of oneof the two sub-pixels 40 a and 40 b is the third color (B) while theother is the first color (R), and forms one of the even column or theodd column of the display init 50. Regarding the up-and-down sub-pixelpair P2R (FIG. 4) or P2L (FIG. 5) connected to the (y+3)-th scanningline Gy+3, the color of one of the two sub-pixels 40 a and 40 b is thefirst color (R) while the other is the second color (G), and forms theother one of the even column or the odd column of the display init 50.Regarding the up-and-down sub-pixel pair P2R (FIG. 4) or P2L (FIG. 5)connected to the (y+4)-th scanning line Gy+4, the color of one of thetwo sub-pixels 40 a and 40 b is the second color (G) while the other isthe third color (B), and forms one of the even column or the odd columnof the display init 50. Regarding the up-and-down sub-pixel pair P2R(FIG. 4) or P2L (FIG. 5) connected to the (y+5)-th scanning line Gy+5,the color of one of the two sub-pixels 40 a and 40 b is the third color(B) while the other is the first color (R), and forms the other one ofthe even column or the odd column of the display part 50.

At this time, the readout control device 130 reads out the viewpointimage data from the image memory 120 according to the readout order asfollows. That is, the readout control device 130: reads out the firstcolor (R) and the second color (G) by corresponding to the y-th scanningline Gy, and reads out the viewpoint image that corresponds to either aneven column or an odd column of the display part 50; reads out thesecond color (G) and the third color (B) by corresponding to the(y+1)-th scanning line Gy+1, and reads out the viewpoint image thatcorresponds to the other one of the even column or the odd column of thedisplay part 50; reads out the third color (B) and the first color (R)by corresponding to the (y+2)-th scanning line Gy+2, and reads out theviewpoint image that corresponds to either the even column or the oddcolumn of the display part 50; reads out read out colors are the firstcolor (R) and the second color (G) by corresponding to the (y+3)-thscanning line Gy+3, and reads out the viewpoint image that correspondsto the other one of the even column or the odd column of the displaypart 50; reads out the second color (G) and the third color (B) bycorresponding to the (y+4)-th scanning line Gy+4, and reads out theviewpoint image that corresponds to either the even column or the oddcolumn of the display part 50; ands reads the third color (B) and thefirst color (R) by corresponding to the (y+5)-th scanning line Gy+5, andreads out the viewpoint image that corresponds to the other one of theeven column or the odd column of the display part 50.

An image processing method according to the exemplary embodiment isachieved by actions of the display controller 100 of the exemplaryembodiment. That is, the image processing method of the exemplaryembodiment is an image processing method for generating the synthesizedimage data CM to be outputted the display module 200, which: reads theparameter showing the positional relation between the first separatingimage (30) and the display part 50 from the parameter storage device140; writes the viewpoint image data for a plurality of viewpointsinputted from the outside to the image memory 120; and reads out theviewpoint image data from the image memory 120 according to a readoutorder that is obtained by applying the parameters to a repeatingregulation that is determined based on the layout of the sub-pixels 40,number of colors, and layout of the colors, and outputs it to thedisplay module 200 as synthesized image data CM. Details of the imageprocessing method according to the exemplary embodiment conform to theactions of the display controller 100 according to the exemplaryembodiment. Image processing methods according to other exemplaryembodiments are achieved by the actions of the display controllers ofthe other exemplary embodiments as in the case of the first exemplaryembodiment, so that explanations thereof are omitted.

An image processing program according to the exemplary embodiment is forcausing a computer to execute the actions of the display controller 100of the exemplary embodiment. When the display controller 100 includes acomputer formed with a memory, a CPU, and the like, the image processingprogram of the exemplary embodiment is stored in the memory, and the CPUreads out, interprets, and executes the image processing program of theexemplary embodiment. That is, the image processing program of theexemplary embodiment is a program for generating the synthesized imagedata CM to be outputted to the display module 200, which causes thecomputer to execute: a procedure which reads the parameter showing thepositional relation between the first separating image (30) and thedisplay part 50 from the parameter storage device 140; a procedure whichwrites the viewpoint image data for a plurality of viewpoints inputtedfrom the outside to the image memory 120; and a procedure which readsout the viewpoint image data from the image memory 120 according to areadout order that is obtained by applying the parameters to a repeatingregulation that is determined based on the layout of the sub-pixels 40,number of colors, and layout of the colors, and outputs it assynthesized image data CM to the display module 200. Details of theimage processing program according to the exemplary embodiment conformto the actions of the display controller 100 according to the exemplaryembodiment. Image processing programs according to other exemplaryembodiments are for causing the computer to execute the actions of thedisplay controllers of the other exemplary embodiments as in the case ofthe first exemplary embodiment, so that explanations thereof areomitted.

With the present invention, it is possible to find the scanning linesG1, - - - and the data lines D1, - - - connected to the sub-pixels 40arranged in an arbitrary row and an arbitrary column without actuallydesigning the layout, since the regularity in the connection patterns ofscanning lines G1, - - - and the data lines D1, - - - for the matrix ofthe sub-pixels 40 has been found. Further, the synthesized image data CMcan easily be generated from the found regularity, the placing conditionof the first image separating device (30), the arranging order of thecolors of the sub-pixels 40, the layout pattern of the up-and-downsub-pixel pair P2R or P2L as the minimum unit, and the like. This makesit possible to use input image data in a same transfer form as that of atypical flat display device, so that there is no load (e.g., beingrequired to rearrange the output image data) imposed upon the devicethat employs the exemplary embodiment. Furthermore, the condition forgenerating the synthesized image data CM is made into parameters, andthe parameter storage device 140 for storing the parameter is provided.Thus, when there is a change in the display module 200, it simply needsto change the parameters and does not need to change the video signalprocessing device. This makes it possible to decrease the number ofdesigning steps and to reduce the cost.

Hereinafter, the first exemplary embodiment will be described in moredetails.

(Explanation of Structures)

Structures of the display device according to the first exemplaryembodiment of the present invention will be described.

FIG. 1 is a schematic block diagram of a stereoscopic display device ofthe exemplary embodiment, which shows an optical model viewed above thehead of an observer. The outline of the exemplary embodiment will bedescribed by referring to FIG. 1. The display device according to theexemplary embodiment is formed with the display controller 100 and thedisplay module 200. The display controller 100 has a function whichgenerates synthesized image data CM from a first viewpoint image data(left-eye image data) M1 and a second viewpoint image data (right-eyeimage data) M2 inputted from outside. The display module 200 includes alenticular lens 30 as an optical image separating device of displayedsynthesized image and a backlight 15 provided to a display panel 20which is the display device of the synthesized image data CM.

Referring to FIG. 1, the optical system of the exemplary embodiment willbe described. The display panel 20 is a liquid crystal panel, and itincludes the first image separating device (30) and the backlight 15.The liquid crystal panel is in a structure in which a glass substrate 25on which a plurality of sub-pixels 41 and 42 (the minimum display part)are formed and a counter substrate 27 having a color filter (not shown)and counter electrodes (not shown) are disposed by sandwiching a liquidcrystal layer 26. On the faces of the glass substrate 25 and the countersubstrate 27 on the opposite sides of the liquid crystal layer 26, apolarization plate (not shown) is provided, respectively. Each of thesub-pixels 41 and 42 is provided with a transparent pixel electrode (notshown), and the polarization state of the transmitted light iscontrolled by applying voltages to the liquid crystal layer 26 betweenthe respective pixel electrodes and the counter electrodes of thecounter substrate 27. Light rays 16 emitted from the backlight 15 passthrough the polarization plate of the glass substrate 25, the liquidcrystal layer 26, the color filter of the counter substrate 27, and thepolarization plate, and intensity modulation and coloring can be donethereby. The lenticular lens 30 is formed with a plurality ofcylindrical lenses 30 a exhibiting the lens effect to one direction,which are arranged along the horizontal direction. The lenticular lens30 is arranged in such a manner that projected images from all thesub-pixels 41 overlap with each other and the projected images from allthe sub-pixels 42 overlap with each other at an observing plane 17 thatis away from the lens by a distance OD, through alternately using theplurality of sub-pixels on the glass substrate 25 as the first viewpoint(left-eye) sub-pixels 41 and the second viewpoint (right-eye) sub-pixels42. With the above-described structure, a left-eye image formed with thesub-pixels 41 is provided to the left eye of the observer at thedistance OD and the right-eye image formed with the sub-pixels 42 isprovided to the right eye.

Next, details of the display controller 100 and the display panel 20shown in FIG. 1 will be described. FIG. 2 is a block diagram of thefirst exemplary embodiment showing the functional structures from imageinput to image display.

The display controller 100 includes the writing control device 110, theimage memory 120, the readout control device 130, the parameter storagedevice 140, and a timing control device 150.

The writing control device 110 has a function which generates a writingaddress given to the inputted image data {Mk (row, column) RGB} inaccordance with the synchronous signal inputted along the image data.Further, the writing control device 110 has a function which gives thewriting address to an address bus 95, and writes the input image dataformed with the pixel data to the image memory 120 via a data bus 90.While the synchronous signal inputted from outside is illustrated with asingle thick-line arrow in FIG. 2 for convenience's sake, thesynchronous signals are formed with a plurality of signals such asvertical/horizontal synchronous signal, data clock, data enable, and thelike.

The readout control device 130 includes: a function which generates areadout address according to a prescribed pattern in accordance withparameter information 51 of the display part 50 supplied from theparameter storage device 140, and a vertical control signal 61 as wellas a horizontal control signal 81 from the timing control device 150; afunction which reads out pixel data via the data bus 90 by giving thereadout address to the address bus 95; and a function which outputs theread out data to a data-line driving circuit 80 as the synthesized imagedata CM.

The parameter storage device 140 includes a function which stores theparameters required for rearranging data in accordance with the layoutof the display part 50 to be described later in more details.

The timing control device 150 includes a function which generates thevertical control signal 61 and the horizontal drive signal 81 fordriving the display part 20, and outputs those to the readout controldevice 130, a scanning-line driving circuit 60, and the data-linedriving circuit 80 of the display panel. While each of the verticalcontrol signal 61 and the horizontal drive signal 81 is illustrated by asingle thick-line arrow in FIG. 2 for the convenience' sake, the signalsinclude a plurality of signals such as a start signal, a clock signal,an enable signal, and the like.

The display panel 20 includes: a plurality of scanning lines G1,G2, - - - , Gm, Gm+1 and the scanning-line drive circuit 60; a pluralityof data lines D1, D2, - - - , Dn, Dn+1 and the data-line driving circuit80; and the display part 50 which is formed with a plurality ofsub-pixels 40 arranged in m-rows×n-columns. FIG. 2 is a schematicillustration of the functional structures, and the shapes and theconnecting relations of the scanning lines, the data lines, and thesub-pixels 40 will be described later. Although not shown, the sub-pixel40 includes a TFT as a switching device and a pixel electrode, and thegate electrode of the TFT is connected to the scanning line, the sourceelectrode is connected to the pixel electrode, and the drain electrodeis connected to the data line. The TFT turns ON/OFF according to thevoltages supplied to the connected arbitrary scanning lines Gysequentially from the scanning-line driving circuit 60. When the TFTturns ON, the voltage is written to the pixel electrode from the dataline. The data-line driving circuit 80 and the scanning-line drivingcircuit 60 may be formed on the glass substrate where the TFTs areformed or may be loaded on the glass substrate or separately from theglass substrate by using driving ICs.

Next, the structure of the sub-pixel 40 which configures the displaypart 50 will be described by referring to the drawing. FIG. 3 is a topview taken from the observer side for describing the structure of thesub-pixel 40 of the exemplary embodiment. The sizes and reduced scalesof each structural element are altered as appropriate for securing thevisibility in the drawing. In FIG. 3, the sub-pixels 40 are illustratedin two types of sub-pixels 40 a and 40 b depending on the facingdirection of its shape. Further, FIG. 3 shows an example in which foursub-pixels form 2-rows×2-columns as a part of the display part 50 shownin FIG. 2. Regarding the XY axes in FIG. 3, X shows the horizontaldirection, and Y shows the vertical direction. Furthermore, in order todescribe the image separating direction, the cylindrical lens 30 aconfiguring the lenticular lens is illustrated in FIG. 3. Thecylindrical lens 30 a is a one-dimensional lens having a semicylindricalconvex part, which does not exhibit the lens effect for the longitudinaldirection but exhibits the lens effect for lateral direction. In thisexemplary embodiment, the longitudinal direction of the cylindrical lens30 a is arranged along the Y-axis direction to achieve the lens effectfor the X-axis direction. That is, the image separating direction is thehorizontal direction X.

The four sub-pixels shown in FIG. 3 as the sub-pixels 40 a and 40 b aresubstantially in a trapezoid form surrounded by three scanning linesGy−1, Gy, Gy+1 arranged in parallel in the horizontal direction andthree data lines Dx, Dx+1, Dx+2 which are repeatedly bent to thehorizontal direction that is the image separating direction.Hereinafter, the substantially trapezoid form is considered a trapezoid,and the short side out of the two parallel sides along the scanninglines Gy, - - - is called a top side E while the long side is called abottom side F. That is, regarding the sub-pixel 40 a and the sub-pixel40 b, the trapezoids thereof face towards the opposite directions formeach other with respect to the vertical direction Y, i.e., thedirections from the respective top sides E to the respective bottomsides F are in an opposite relation.

Each of the sub-pixels 40 a and 40 b has a pixel electrode 45, a TFT 46,and a storage capacitance 47. The TFT 46 is formed at the intersectionbetween a silicon layer 44 whose shape is shown with a thick line inFIG. 3 and the scanning lines Gy, - - - , and the TFT 46 includes adrain electrode, a gate electrode, and a source electrode, not shown.The gate electrode of the TFT 46 is formed at the intersection betweenthe scanning lines Gy, - - - and the silicon layer 44, and connected tothe scanning lines Gy, - - - . The drain electrode is connected to thedata lines Dx, - - - via a contact hole 48. The source electrode isconnected to the pixel electrode 45 whose shape is shown with a dottedline in FIG. 3 via a contact hole 49. Further, the silicon layer 44 thatis on the source electrode side with respect to the scanning lines Gyforms the storage capacitance 47 between a storage capacitance line CSformed via an insulating film and itself. The storage capacitance lineCS is arranged to bend so as to connect the storage capacitances 47 ofeach sub-pixel neighboring along the extending direction of the scanninglines Gy, - - - , i.e., along the X-axis direction. Further, theintersection points between the storage capacitance lines CS and thedata lines Dx, - - - are arranged to be lined along the data linesDx, - - - .

As shown in FIG. 3, regarding the sub-pixel 40 a and the sub-pixel 40 b,the shapes, layouts, and connecting relations of the respective pixelelectrodes 45, TFTs 46, contact holes 48, 49, and storage capacitances47 are in a point-symmetrical relation with each other. That is, on anXY plane, when the sub-pixel 40 a including each structural element isrotated by 180 degrees, the structural shape thereof matches with thatof the sub-pixel 40 b.

Regarding the aperture parts of the sub-pixels 40 a and 40 b arranged inthe manner described above, the proportions of the aperture parts andthe light-shield parts in the Y-axis direction orthogonal to the imageseparating direction are substantially constant for the X-axis directionthat is the image separating direction. The aperture part is an areacontributing to display, which is surrounded by the scanning line, thedata line, the storage capacitance line CS, and the silicon layer 44,and is also covered by the pixel electrode 45. The area other than theaperture part is the light-shield part. Thus, the proportion of theaperture part and the light-shield part in the Y direction is theone-dimensional numerical aperture which is obtained by dividing thelength of the aperture part when the sub-pixel 40 a or the sub-pixel 40b is cut in the Y-axis direction by the pixel pitch in the Y-axisdirection. Hereinafter, the one-dimensional numerical aperture in thedirection orthogonal to the image separating direction is called alongitudinal numerical aperture.

Therefore, “the proportions of the aperture parts and the light-shieldparts in the Y-axis direction are substantially constant for the Xdirection” specifically means that it is so designed that thelongitudinal numerical aperture along the line B-B′ shown in FIG. 3 (thevalue obtained by dividing the length of the aperture of the sub-pixel40 a along the line B-B′ by the distance between the scanning line Gy−1and Gy) becomes almost equivalent to the longitudinal numerical aperturealong the line A-A′ (the value obtained by dividing the sum of thelength of the aperture part of the sub-pixel 40 b and the length of theaperture part of the sub-pixel 40 a along the line A-A′ by the distancebetween the scanning lines Gy−1 and Gy).

The display part of the present invention is configured with thesub-pixels 40 a and 40 b having the above-described structure and thefeatures. In the present invention, two sub-pixels 40 a and 40 b facingtowards the different directions are treated as one structural unit, andthe sub-pixels 40 a and 40 b which are connected to the common scanningline Gy, - - - and lined in the vertical direction are called“up-and-down sub-pixel pair”. Specifically, the sub-pixel 40 a connectedto the data line Dx+1 and the sub-pixel 40 b connected to the data lineDx, which are connected to the scanning line Gy shown in FIG. 3 andarranged along the vertical direction, are defined as the “up-and-downsub-pixel pair” and treated as the structural unit of the display part.

FIG. 4A is a plan view showing the up-and-down sub-pixel pair, which isa block diagram of the up-and-down sub-pixel pair taken from FIG. 3.FIG. 4B is an equivalent circuit of the up-and-down sub-pixel pair shownin FIG. 4A, in which the scanning lines Gy, - - - , the data lines Dx,the pixel electrodes 45, and the TFTs 46 are shown with same referencenumerals. The up-and-down sub-pixel pair shown in FIG. 4 is named as theup-and-down sub-pixel pair P2R. FIG. 4C is an illustration which showsFIG. 3 with an equivalent circuit of the up-and-down sub-pixel pair P2R,and the four sub-pixels surrounded by a dotted line correspond to FIG.3. As shown in FIG. 4C, the four sub-pixels neighboring to each other inFIG. 3 are configured with three up-and-down sub-pixel pairs. This isbecause the up-and-down sub-pixel pairs neighboring to each other alongthe extending direction of the scanning lines Gy, - - - are connected todifferent scanning lines Gy, - - - with respect to each other.

The reasons why the exemplary embodiment employing the display partconfigured with the up-and-down sub-pixel pairs can achieve the highnumerical aperture and high image quality in the stereoscopic displaydevice will be described. In order to achieve the high numericalaperture and the high image quality, it is necessary to increase thelongitudinal numerical aperture while keeping the constant longitudinalnumerical aperture of the pixels regardless of the positions in theimage separating direction.

First, it is preferable for the scanning lines and the data lines to bedisposed in the periphery of each pixel electrode. This is because theremay be dead space that does not contributes to display generated betweenthe wirings, thereby decreasing the numerical aperture, if there is nopixel electrode between scanning lines or the data lines. In thisexemplary embodiment, as shown in FIG. 3, the scanning lines Gy, - - -and the data lines D, - - - are disposed in the periphery of each pixelelectrode 45. Further, each of the TFTs 46 of the up-and-down sub-pixelpairs is connected to the respective data lines Dx, - - - which aredifferent from each other. Furthermore, regarding the layout of theup-and-down sub-pixel pairs in the horizontal direction, i.e., thelayout in the extending direction of the scanning lines Gy, - - - , thepairs are arranged neighboring to each other while being shifted fromeach other by one sub-pixel in the vertical direction. Thus, theup-and-down sub-pixel pairs neighboring to each other in the extendingdirection of the scanning lines Gy, - - - are connected to therespective scanning lines Gy, - - - which are different from each other.With the layout and the connecting relations described above, it becomespossible to suppress the number of necessary wirings and to improve thenumerical aperture.

Further, the data lines need to be bent towards the image separatingdirection in order to have the constant longitudinal numerical apertureregardless of the positions along the image separating direction. As thefactors for determining the longitudinal numerical aperture, there arethe structure of the bent oblique sides, the structure between thebottom sides of the substantially trapezoid aperture parts, and thestructure between the upper sides thereof. More specifically, regardingthe vertical line cutting the oblique side as shown in the line A-A′ ofFIG. 3, the height (length) of the oblique side in the Y-axis directionand the height between the bottom sides (distance between the twoneighboring bottom sides) affect the longitudinal numerical aperture.Furthermore, regarding the vertical line cutting the TFT 46 as shown inthe line B-B′ of FIG. 3, the height between the upper sides (distancebetween the two neighboring upper sides) and the height between thebottom sides affect the longitudinal numerical aperture.

The common thing between the line A-A′ and the line B-B′ is the heightbetween the bottom sides. Thus, first, the structure for minimizing theheight between the bottom sides is investigated. As described above, itis necessary to place at least one scanning line between the bottomsides. It is preferable to limit the structure to have one scanning linefor minimizing the height between the bottom sides. For example, if theTFT is placed between the bottom sides, the height between the bottomsides becomes increased for that. Thus, it is not preferable.Particularly, in the line A-A′, the bottom sides overlap with eachother. Thus, the influence is extensive when the height between thebottom sides is increased. It needs to avoid having structures placedbetween the bottom sides as much as possible. Further, when the storagecapacitance lines are formed with the same layer as that of the scanninglines, it is preferable not to place the storage capacitance linebetween the bottom sides. This makes it possible to cut the number ofprocesses while decreasing the height between the bottom sides.

Next, the height of the oblique side in the line A-A′ is investigated.It is extremely important to reduce the width of the oblique side inorder to cut the height of the oblique side. For reducing the width ofthe oblique side, it is preferable not to place structures in theoblique side as much as possible. However, as described above, it isnecessary to place at least one data line. Further, when the storagecapacitance lines are formed with the same layer as that of the scanninglines, particularly the storage capacitance line can be arranged to besuperimposed on the data line. In that case, the intersection partbetween the storage capacitance line CS and the data line DS is disposedto be along the data line. This makes it possible to cut the height ofthe oblique sides and to improve the longitudinal numerical aperture.

At last, the height between the upper sides in the line B-B′ isinvestigated. As described above, it is not preferable to place the TFTbetween the bottom sides and in the oblique side. Thus, the TFT needs tobe placed between the upper sides. Therefore, the layout for decreasingthe height between the upper sides becomes important. In the exemplaryembodiment, as shown in FIG. 3, the TFT 46 is placed between the uppersides. Further, the silicon layer 44 is placed by being stacked on thedata lines Dx, - - - to prevent the increase of the light-shield parts,so that the numerical aperture can be improved.

As shown in FIG. 3, it is most efficient to dispose the storagecapacitance CS in the vicinity of the TFT 46 for forming the storagecapacitance. This is evident based on the fact that the storagecapacitance is formed between the electrode connected to the sourceelectrode of the TFT 46 and the electrode connected to the storagecapacitance line CS.

As described, the layout of the sub-pixels according to this exemplaryembodiment shown in FIG. 3 achieves the high numerical aperture and thehigh image quality in the stereoscopic display device. That is, thedisplay unit of the exemplary embodiment formed with a plurality ofup-and-down sub-pixel pairs by having the up-and-down sub-pixel pairdescribed above by referring to FIG. 4 as the structural unit is capableof achieving the high numerical aperture and the high image quality.

While the structure of the display part according to the exemplaryembodiment has been described heretofore by referring to the up-and-downsub-pixel pairs shown in FIG. 3 and FIG. 4, it is also possible toemploy the structure of the display part which uses the up-and-downsub-pixel pair P2L that is mirror symmetrical with the up-and-downsub-pixel pair P2R shown in FIG. 4. FIG. 5A shows a plan view of thestructure of the up-and-down sub-pixel pair P2L, and FIG. 5B shows anequivalent circuit of the up-and-down sub-pixel pair P2L. As shown inFIG. 5A, sub-pixels 40 a′ and 40 b′ configuring the up-and-downsub-pixel pair P2L are line-symmetrical with the sub-pixels 40 a and 40b shown in FIG. 4A with respect to the Y-axis in terms of the shapes,layouts, and connecting relations of the pixel electrodes 45, the TFTs46, the contact holes 48, 49, and the storage capacitances as thestructural elements. That is, the up-and-down sub-pixel pair P2R and theup-and-down sub-pixel pair P2L are line-symmetrical with respect to theY-axis, line-symmetrical with respect to the X-axis, and in a relationof the mirror symmetrical with respect to each other.

Therefore, when the up-and-down sub-pixel pairs P2L shown in FIG. 5configure the display part with no difference in the numerical aperturefrom that of the up-and-down sub-pixel pairs P2R, the high numericalaperture and the high image quality can be achieved as well in anequivalent manner.

Note here that the sub-pixels configuring the up-and-down sub-pixel pairconnected to a common scanning line are called as “upward sub-pixel” andas “downward sub-pixel” according to the facing direction of the bottomside F of the trapezoid, and the terms are used in the followingexplanations. That is, within the up-and-down sub-pixel pair P2R shownin FIG. 4, the sub-pixel 40 a is the “upward sub-pixel”, and thesub-pixel 40 b is the “downward sub-pixel”. Similarly, within theup-and-down sub-pixel pair P2L shown in FIG. 5, the sub-pixel 40 a′ isthe “upwards sub-pixel”, and the sub-pixel 40 b′ is the “downwardsub-pixel”. As described above, the optical effects obtained due to thestructures thereof are the same for the up-and-down sub-pixel pairs P2Rand P2L. However, the data lines Dx, Dx+1 to which the upward sub-pixeland the downward sub-pixel are connected are inverted.

The display part of the exemplary embodiment may be configured with theup-and-down sub-pixel pairs P2R or with the up-and-down sub-pixel pairsP2L. Further, the display part may be configured by combining theup-and-down sub-pixel pairs P2R and the up-and-down sub-pixel pairs P2L.Hereinafter, a structural example of the display part 50 of theexemplary embodiment shown in FIG. 2 will be described by referring to acase which displays a first viewpoint image (left-eye image) and asecond viewpoint image (right-eye image) configured with pixels of4-rows×6-columns. First, input image data will be described by referringto FIG. 6, and the image separating device and the color arrangingrelation of the display part according to the exemplary embodiment willbe described by referring to FIG. 7. A specific example of the displaypart will be provided after the explanations of FIG. 6 and FIG. 7.

FIG. 6 shows charts of image data of the first viewpoint image (left-eyeimage) and the second viewpoint image (right-eye image) configured withthe pixels of 4-rows×6-columns. As described above, “k” is a viewpoint(left, right), “i” is the row number within the image, “j” is the columnnumber within the image, “RGB” means that the pixel carries colorinformation of R: red, G: green, and B: blue.

FIG. 7 is an example of the display part 50 which displays two imagesshown in FIG. 6, showing the layout of the image separating device andthe colors of the sub-pixels. Regarding the XY axes in the drawing, Xshows the horizontal direction and Y shows the vertical direction.

In FIG. 7, the sub-pixel is illustrated with a trapezoid, and shadingsare applied to show examples of colors. Specifically, a red (R) colorfilter is arranged on a counter substrate of the sub-pixel lined on thefirst row in the horizontal direction, and the first row functions asthe sub-pixels which display red. A green (G) color filter is arrangedon a counter substrate of the sub-pixel lined on the second row in thehorizontal direction, and the second row functions as the sub-pixelswhich display green. A blue (B) color filter is arranged on a countersubstrate of the sub-pixel lined on the third row in the horizontaldirection, and the third row functions as the sub-pixels which displayblue. In the same manner, the sub-pixels on the fourth row andthereafter function in order of red, green, and blue in a row unit. Theexemplary embodiment can be adapted to arbitrary color orders. Forexample, the colors may be arranged in repetitions of the order of blue,green, and red from the first row.

For the image separating device, the cylindrical lens 30 a configuringthe lenticular lens 30 corresponds to the sub-pixels of two-column unit,and it is arranged in such a manner that the longitudinal directionthereof exhibiting no lens effect is in parallel to the verticaldirection, i.e., in parallel to the columns. Thus, due to the lenseffect of the cylindrical lenses 30 a in the X direction, light raysemitted from the sub-pixels on the even-numbered columns and theodd-numbered columns are separated to different directions. That is, asdescribed by referring to FIG. 1, at a position away from the lensplane, the light rays are separated into an image configured with thepixels of the even-numbered columns and an image configured with thepixels of odd-numbered columns. As an example, with this exemplaryembodiment in the layouts of FIG. 7 and FIG. 1, the sub-pixels on theeven-numbered columns function as the image for the left eye (firstviewpoint) and the sub-pixels on the odd-numbered columns function asthe image for the right eye (second viewpoint).

The color filters and the image separating device are disposed in theabove-described manner, so that one pixel of the input image shown inFIG. 6 is displayed with three sub-pixels of red, green, and blue linedon one column shown in FIG. 7. Specifically, the three sub-pixels on thefirst, second, and third rows of the second column display theupper-left corner pixel: M1(1, 1) RGB of the left-eye (first viewpoint)image, and the three sub-pixels on the tenth, eleventh, and twelfth rowsof the eleventh column display the lower-right corner pixel: M2(4, 6)RGB of the right-eye (second viewpoint) image. Further, the sub-pixelpitch of every two columns and the sub-pixel pitch of every three rowsare equal, so that the resolution at the time of stereoscopic displaywhich has inputted left and right images as parallax images and theresolution at the time of flat display which has the inputted left andright images as the same images are equal. Thus, it is the feature ofthis exemplary embodiment that there is no degradation in the imagequality caused due to changes in the resolution. Further, the samecolors are arranged in the direction of the lens effect, so that thereis no color separation generated by the image separating device. Thismakes it possible to provide the high image quality.

The connecting relations regarding a plurality of sub-pixels arranged inthe matrix shown in FIG. 7 and the scanning lines as well as the datalines, i.e., a specific example for configuring the display part fromthe up-and-down sub-pixels shown in FIG. 4 and FIG. 5, are shown in FIG.8-FIG. 11 and will be described hereinafter.

FIG. 8 shows a layout pattern 1 of the display part which is formed withthe up-and-down sub-pixel pairs P2R shown in FIG. 4. By having theposition where the upward sub-pixel of the up-and-down sub-pixel pairP2R comes on the first row of the first column as the start, theup-and-down sub-pixel pairs P2R are disposed. At this time, the downwardsub-pixels of the up-and-down sub-pixel pairs P2R are disposed on thefirst row of the even-numbered columns, and the upward sub-pixels do notconfigure the display part. Similarly, the upward sub-pixels of theup-and-down sub-pixel pairs P2R are disposed on the twelfth row of theeven-numbered columns, and the downward sub-pixels do not configure thedisplay part. “NP” shown in FIG. 8 indicates that sub-pixels that do notconfigure the display part are not disposed. Further, FIG. 8 correspondsto FIG. 7, shading in each pixel shows the display color, and thesub-pixels on the even-numbered columns function as the left-eye (firstviewpoint) sub-pixels while the sub-pixels on the odd-numbered columnsfunction as the right-eye (second viewpoint) sub-pixels by an opticalseparating device, not shown.

FIG. 9 shows a layout pattern 2 of the display part which is formed withthe up-and-down sub-pixel pairs P2L shown in FIG. 5. FIG. 9 is the sameas the case of FIG. 8 except that the up-and-down sub-pixel pairs P2Rare changed to the up-and-down sub-pixel pairs P2L, so that explanationsthereof are omitted.

FIG. 10 shows a layout pattern 3 which is a first example of configuringthe display part with a combination of the up-and-down sub-pixel pairsP2R shown in FIG. 4 and the up-and-down sub-pixel pairs P2L shown inFIG. 5. As shown in FIG. 10, on the first column, by having the positionwhere the upward sub-pixel of the up-and-down sub-pixel pair P2L comeson the first row of the first column as the start point, the up-and-downsub-pixel pair P2L and the up-and-down sub-pixel pair P2R are repeatedlydisposed in the vertical direction. On the second column, by having theposition where the downward sub-pixel of the up-and-down sub-pixel pairP2R comes on the first row of the second column as the start point, theup-and-down sub-pixel pair P2R and the up-and-down sub-pixel pair P2Lare repeatedly disposed in the vertical direction. On the third column,by having the position where the upward sub-pixel of the up-and-downsub-pixel pair P2R comes on the first row of the third column as thestart point, the up-and-down sub-pixel pair P2R and the up-and-downsub-pixel pair P2L are repeatedly disposed in the vertical direction. Onthe fourth column, by having the position where the downward sub-pixelof the up-and-down sub-pixel pair P2L comes on the first row of thefourth column as the start point, the up-and-down sub-pixel pair P2L andthe up-and-down sub-pixel pair P2R are repeatedly disposed in thevertical direction. On the fifth column and thereafter, the layoutpattern from the first column to the fourth column is repeated. Thislayout pattern 3 has an effect of achieving the high image quality in acase where the dot inversion driving method is employed to the polarityinversion driving. Details thereof will be described later.

FIG. 11 shows a layout pattern 4 which is a second example ofconfiguring the display part with a combination of the up-and-downsub-pixel pairs P2R shown in FIG. 4 and the up-and-down sub-pixel pairsP2L shown in FIG. 5. As shown in FIG. 11, by having the position wherethe upward sub-pixel of the up-and-down sub-pixel pair P2L comes on thefirst row of the first column as the start point, the first column andthe second column are formed with the up-and-down sub-pixel pairs P2L.The third column and the fourth column are formed from the up-and-downsub-pixel pairs P2R by having the position where the upward sub-pixel ofthe up-and-down sub-pixel pair P2R comes on the first row of the thirdcolumn as the start point. On the fifth column and thereafter, thelayout with every two columns described above is repeated. This layoutpattern 4 has an effect of achieving the high image quality in a casewhere the vertical 2-dot inversion driving method is employed to thepolarity inversion driving. Details thereof will be described later.

As shown in FIG. 8-FIG. 11, the display part configured with 12 rows×12columns of sub-pixels takes the up-and-down sub-pixel pair as thestructural unit, so that it is necessary to have thirteen scanning linesfrom G1 to G13 and thirteen data lines from D1 to D13. That is, thedisplay part of the exemplary embodiment configured withm-rows×n-columns of sub-pixels is characterized to be driven by (m+1)pieces of scanning lines and (n+1) pieces of data lines.

Further, the display part of the exemplary embodiment can be structuredwith various layout patterns other than those that are described aboveas a way of examples by having the up-and-down sub-pixel pairs shown inFIG. 4 and FIG. 5 as the structural unit.

However, the difference in the layout pattern influences the polaritydistribution of the display part when the liquid crystal panel is drivenwith the polarity inversion drive. Further, as can be seen from FIG.8-FIG. 11, in the display part of the present invention, the sub-pixelslined on one row in the horizontal direction are connected to twoscanning lines alternately, and the sub-pixels lined on one column inthe vertical direction are connected to two data lines with theregularity according to the layout pattern. Thus, the polaritydistribution thereof obtained according to the polarity inversiondriving method is different from that of a typical liquid crystal panelin which the sub-pixels on one row are connected to one scanning lineand the sub-pixels on one column are connected to one data line, so thatthe effect obtained thereby is different as well. Hereinafter, detailsof the effects obtained for each of the layout patterns of the exemplaryembodiment when the polarity inversion driving method of the typicalliquid crystal panel is employed will be described.

FIG. 12 shows the polarity distribution of the display part when a gateline inversion drive (1H inversion drive) is employed to the layoutpattern 2 shown in FIG. 9, and shows the data line polarity for eachscanning line under the gate line inversion drive. In the illustration,“+” and “−” show the positive/negative polarities of the pixelelectrodes and the data lines in an arbitrary frame (a period wherescanning of all the scanning lines is done), and negative and positivepolarities are inverted in a next frame. The gate line inversion driveis a driving method which inverts the polarity of the data line by eachperiod of selecting one scanning line, which can reduce the resistingpressure of a data-line driving circuit (driver IC for driving dataline) by being combined with the so-called common inversion drive whichAC-drives the common electrodes on the counter substrate side. Thus, itonly requires a small amount of power consumption. However, the imagesseparated by the image separating device, i.e., the left-eye imageconfigured with the even-numbered columns and the right-eye imageconfigured with the odd-numbered columns, are frame inverted with whichthe entire display images are polarity-inverted by a frame unit. Withthe frame inversion, the so-called flickers (the displayed images areseen with flickering) tend to be observed due to a difference in theluminance generated in accordance with the polarity. When the flickersare observed, the flickers can be suppressed by increasing framefrequency.

In a case where the gate line inversion drive is employed to theexemplary embodiment, it is more preferable to employ the drive whichinverts the polarity for each of a plurality of scanning lines asillustrated in FIG. 13. FIG. 13 shows the polarity distribution of thedisplay part when a gate 2-line inversion drive (2H inversion drive) isemployed to the layout pattern 2 shown in FIG. 9, and the data linepolarity for each scanning line of the gate 2-line inversion drive. “+”and “−” in the drawing show the polarity as in the case of FIG. 12. Fromthe polarity distribution of FIG. 13, the polarity of each of theseparated left-eye image and right-eye image is inverted by two rows ofsub-pixels. Therefore, it is possible to suppress flickers, and toachieve the high image quality.

FIG. 14 shows the polarity distribution of the display part when a dotinversion drive is employed to the layout pattern 2 shown in FIG. 9, andshows the data line polarity for each scanning line under the dotinversion drive. “+” and “−” in the drawing show the polarity as in thecase of FIG. 12. As shown in FIG. 14, the dot inversion drive is adriving method which inverts the polarity by each data line and,further, inverts the polarity of the data line by every selecting periodof one scanning line. It is known as a method which suppresses flickersand achieves the high image quality in a typical liquid crystal panel.When the dot inversion drive is employed to the layout pattern 2 of theexemplary embodiment, the polarities on the odd-numbered columns are thesame in a row unit (i.e., the polarities on all the odd-numbered columnson one row are the same) as shown in the polarity distribution of FIG.14. This is the same for the even-numbered columns. Therefore, for eachof the separated left-eye image and right-eye image, it is possible toachieve the same flicker suppressing effect as the case of employing thegate line inversion drive (1H inversion drive) to a typical panel.

FIG. 15 shows the polarity distribution of the display part when a dotinversion drive is employed to the layout pattern 3 shown in FIG. 10,and shows the data line polarity for each scanning line under the dotinversion drive. “+” and “−” in the drawing show the polarity as in thecase of FIG. 12. Polarity inversion on the odd-numbered columns isrepeated in a column unit such as on the first row and the third row,the third row and the fifth row, - - - in each row unit as shown in thepolarity distribution of FIG. 15. This is the same for the even-numberedcolumns. Further, regarding the polarity distribution within a column,the polarities of the pixel electrodes of the up-and-down sub-pixelpairs P2L and the up-and-down sub-pixel pairs P2R neighboring to eachother in the vertical direction are the same, and the polarity isinverted by every two rows. Thus, the long sides of the pixel electrodeseach in a trapezoid form, i.e., the bottom sides of the sub-pixels, cometo be in the same polarities. Therefore, it is possible to suppressabnormal alignment of the liquid crystal molecules in the vicinity ofthe bottom sides, so that the high image quality can be achieved.Further, for each of the separated left-eye image and right-eye image,the columns whose polarities are inverted for every two rows ofsub-pixels in the vertical direction are inverted by a column unit. Thisprovides a high flicker suppressing effect, so that the high imagequality can be achieved.

FIG. 16 shows the polarity distribution of the display part when avertical 2-dot inversion drive is employed to the layout pattern 4 shownin FIG. 11, and shows the data line polarity for each scanning line ofthe vertical 2-dot inversion drive. “+” and “−” in the drawing show thepolarity as in the case of FIG. 12. As shown in FIG. 16, the vertical2-dot inversion drive is a driving method which inverts the polarity byeach data line and, further, inverts the polarity of the data line byevery selecting period of two scanning lines. Compared to the case ofthe dot inversion drive, the polarity inversion cycle for each data linebecomes doubled. Thus, the power consumption of the data-line drivingcircuit (driver IC for driving data line) can be reduced. The polaritydistribution of FIG. 16 is the same as the polarity distribution of FIG.15. Therefore, as in the case of FIG. 15, it is possible to suppressabnormal alignment of the liquid crystal molecules in the vicinity ofthe bottom sides. This provides a high flicker suppressing effect, sothat the high image quality can be achieved.

As described above, the combination of the layout pattern of the displaypart and the polarity driving method may be selected as appropriateaccording to the target display quality, the power consumption, and thelike. Further, with the display part of the exemplary embodiment, it isalso possible to employ layout patterns and polarity inversion drivingmethods other than those described above as examples. For example, it ispossible to employ a layout pattern 5 shown in FIG. 17. With the layoutpattern 5, the display part is configured with the up-and-down sub-pixelpairs P2R shown in FIG. 4 by having the position where the upwardsub-pixel comes at the first row of the second column as the startpoint. The layout pattern 5 shown in FIG. 17 and the layout pattern 1shown in FIG. 8 configured with the same up-and-down sub-pixel pairs P2Rare in a relation which is being translated in the horizontal directionby one column.

However, the synthesized image data CM outputted to the data-linedriving circuit 80 shown in FIG. 2 needs to be changed in accordancewith the changes in the layout pattern. The synthesized image data CM isthe image data synthesized from input images M1 and M2, which is thedata inputted to the data-line driving circuit 80 for writing thevoltage to each pixel electrode of the display part 50 which isconfigured with the sub-pixels of m-rows×n-columns. That is, thesynthesized image data CM is the data obtained by rearranging each ofthe pixel data configuring the input image data M1 and M2 to correspondto the data lines from D1 to Dn+1 by each of the scanning lines from G1to Gm+1, and it is expressed with a data structure of (Gm+1) rows and(Dn+1) columns.

Therefore, as can be seen from the layout patterns 1 to 5 shown in FIG.8-FIG. 11 and FIG. 17, the synthesized image data CM becomes differenteven with the sub-pixel that is designated on a same row and samecolumn, since the connected data lines or the scanning lines verydepending on the layout patterns.

As specific examples, FIG. 18-FIG. 22 show the synthesized image data CMwhen the input image data shown in FIG. 6 is displayed on the displayparts of the layout patterns 1-5 while the image separating device isarranged as in FIG. 7. FIG. 18-FIG. 22 show the positions and colors ofthe input image data to be supplied to an arbitrary data line Dx when anarbitrary scanning line Gy is selected. M1 and M2 are viewpoint images,(row number, column number) shows the position within the image, andR/G/B shows the color. Further, “x” mark indicates that there is nopixel electrode. Naturally, there is no input data M1, M2 correspondingto “x” mark and no pixel electrode to which the supplied data to bereflected, so that the data to be supplied to “x” mark is optional.

The synthesized image data CM can be generated from the connectionregularity of the up-and-down sub-pixel pairs in a unit of scanning lineand the regularity in a unit of data line based on the color arrangementof the color filters shown in FIG. 7, the layout patterns shown in FIG.8-FIG. 11 and FIG. 17, and setting parameters of the image separatingdevice to be described later.

The regularity in a unit of scanning line will be described.

In the exemplary embodiment, viewpoint images M1/M2 to be displayed witheven/odd of the scanning lines are designated. This is because of thereason as follows. That is, in the layout of the up-and-down sub-pixelpairs configuring the display part, the up-and-down sub-pixel pairssharing the same scanning line cannot be lined side by side on twocolumns but necessarily arranged on every other column. That is,even/odd of the scanning lines correspond to even/odd of the columns ofthe sub-pixel layout. Further, designation of the viewpoint images M1/M2is determined by a column unit of the sub-pixels by the image separatingdevice.

The factors for determining the even/odd of the scanning lines and theviewpoint images M1/M2 are the layout of the image separating device andthe layout pattern.

The image separating device is not limited to be placed in the mannershown in FIG. 7 but may also be placed in the manner as shown in FIG.23, for example. In FIG. 7, as described above, the first column is M2and the second column is M1, i.e., the sub-pixels on the odd-numberedcolumn are M2 and the sub-pixels on the even-numbered columns are M1. Inthe case of FIG. 23, the first column is M1 and the second column is M2,i.e., the sub-pixels on the odd-numbered column are M1 and thesub-pixels on the even-numbered columns are M2. As described, even/oddof the columns where the viewpoint images M1/M2 are displayed isdetermined depending on the layout of the image separating device.

Even/odd of the scanning lines corresponding to the odd-numbered columnsand the even-numbered columns on the display part is determined whetherthe sub-pixel located on the first row of the first column on thedisplay part is the upward sub-pixel or the downward sub-pixel. FIG. 8is a layout example of the case where the sub-pixel on the first row ofthe first column is the upward sub-pixel, and FIG. 17 is a layoutexample of the case where the sub-pixel on the first row of the firstcolumn is the downward sub-pixel. It is assumed here that the facingdirections (upward or downward) of the sub-pixel to be placed on thefirst row of the first column is a variable “u”, and the sub-pixel onthe first row of the first column is the upward sub-pixel when u=0 whilethe sub-pixel on the first row of the first column is the downwardsub-pixel when u=1. As shown in FIG. 8 and FIG. 17, when the sub-pixelon the first row of the first column is the upward sub-pixel, i.e., whenu=0, the odd-numbered scanning lines are connected to the sub-pixels onthe even-numbered columns, and the even-numbered scanning lines areconnected to the sub-pixel on the odd-numbered columns. When thesub-pixel on the first row of the first column is the downwardsub-pixel, i.e., when u=1, the odd-numbered scanning lines are connectedto the sub-pixels on the odd-numbered columns, and the even-numberedscanning lines are connected to the sub-pixel on the eve-numberedcolumns.

The relation between the even/odd of the scanning lines and theviewpoint images M1/M2 determined in the manner described above issummarized in FIG. 24. In FIG. 24, a viewpoint of an input image towhich the odd-numbered scanning line corresponds is shown with “v1”, anda viewpoint of an input image to which the even-numbered scanning linecorresponds is shown with “v2”. FIG. 24 shows that, when the imageseparating device is so disposed that the odd-numbered columns of thedisplay part are M1 and the even-numbered columns are M2 and that thesub-pixel on the first row of the first column in the display part isthe upward sub-pixel, “v1=2 and v2=1” applies. That is, the viewpointimages on the odd-numbered scanning lines are M2, and the viewpointimages on the even-numbered scanning lines are M1.

R/G/B to be the color of the first row is determined by the colorfilter. One scanning line is connected to the sub-pixels of two rows.Thus, the regularity of the colors corresponding to the scanning linesis determined, when the color on the first row set by the color filterand the order of colors are determined.

Further, the pixel data of the input image carries RGB colorinformation, so that one row expressed with input image “i” correspondsto three rows of sub-pixels. Regarding the up-and-down sub-pixel pair,the sub-pixels are disposed on up-and-down by sandwiching a singlescanning line therebetween. Thus, a single scanning line corresponds totwo rows of sub-pixels. Accordingly, as a relation between the rows ofthe input image and the scanning lines, there is a periodicity havingsix scanning lines as a unit.

FIG. 25 shows the summary of the regularity in a scanning line unitaccording to the exemplary embodiment. An arbitrary scanning line Gy isexpressed by using an arbitrary natural number “q”, and “M(k)” is inputimage viewpoint to which the up-and-down sub-pixel pair connected to theGy(q) connects, C1(R/G/B) is the color of the upwards sub-pixel, C2(R/G/B) is the color of the downward sub-pixel, and (Ui/Di) is the rowsof the vertically arranged sub-pixels. The row of the input imagecorresponding to the upward sub-pixel of the sub-pixel pair is definedas Ui, and the row of the input image corresponding to the downwardsub-pixel of the sub-pixel pair is defined as Di. By using theregularity shown in FIG. 25, the viewpoints of the input image on anarbitrary signal line Gy, colors, rows can be designated when generatingthe synthesized image data. However, as illustrated in FIG. 8-FIG. 11and FIG. 17, the top row (first row in the drawing) and the last row(twelfth row in the drawing) of the display part are configured with theup-and-down sub-pixel pairs including NP. That is, the up-and-downsub-pixel pairs connected to the top line of the scanning lines (G1 inthe drawing) and to the last line (G13 in the drawing) include NP. Ifthe regularity shown in FIG. 25 is applied including NP, the rows withno input image (shown in FIG. 6) may be designated for NP. Thus, whenactually generating the synthesized image data by using the regularityof FIG. 25, it needs to be careful about handling NP.

Next, the regularity in a unit of data line will be described.

Due to the structure of the up-and-down sub-pixel pairs, two data linesare used for one column of sub-pixels, so that (n+1) data lines arenecessary for n-columns of sub-pixels of the display part. However, asdescribed above, one scanning line and the up-and-down sub-pixel pairare disposed by every other column. That is, one scanning line and theup-and-down sub-pixel pair are disposed on an odd-numbered column or aneven-numbered column, and the number of up-and-down sub-pixel pairsconnected to one scanning line is “n/2”.

Considering the number of data lines connected to the sub-pixel by eachscanning line, it is separated to a case where n-number of data linesfrom D1 to Dn are connected and Dn+1 is not connected to the sub-pixeland to a case where n-number of data lines from D2 to Dn+1 are connectedand D1 is not connected. This is evident from the layout patterns ofFIG. 8-FIG. 11 and FIG. 17 illustrated as the specific examples.

By using the regularity shown in FIG. 25, the viewpoints of the inputimage on an arbitrary signal line Gy, colors, rows for an arbitraryscanning line can be designated. It is the regularity regarding thecorrespondence between the number of data lines and the column number ofthe input image data required by a unit of data line. As describedabove, the number of up-and-down sub-pixel pairs connected to onescanning line is “n/2”, the number of sub-pixels is “n”, and the numberof connected data lines is “n”.

Thus, the data layout for one scanning line is expressed in order withvariables as in L(1), L(2), - - - , L(n) and have those correspondedwith the column order of the input image data. The direction of increasein the order of L is defined to be the same increasing direction of theorder of the data lines. As a specific example, the data layout of thescanning line G2 can be expressed as follows by using the synthesizedimage data 1 shown in FIG. 18 that is the case where the imageseparating device of FIG. 7 is placed to the layout pattern 1 shown inFIG. 8.

L(1)=M2 (1, 1) G

L(2)=M2 (1, 1) R

L(3)=M2 (1, 2) G

L(4)=M2 (1, 2) R

- - -

L(11)=M2 (1, 6) G

L(12)=M2 (1, 6) R

Further, the data layout of the scanning line G3 can be expressed asfollows by using the same drawing.

L(1)=M1 (1, 1) B

L(2)=M1 (1, 1) G

L(3)=M1 (1, 2) B

L(4)=M1 (1, 2) G

- - -

L(11)=M1 (1, 6) B

L(12)=M1 (1, 6) G

As in the above, when the number of the data layout is increased by 2,the column number of the input image is increased by 1. This is becausethe two sub-pixels of the up-and-down sub-pixel pair lined on one columnshows two colors. This shows that the order of the up-and-down sub-pixelpairs connected to one scanning line in the horizontal directioncorresponds to the column number of the input image data.

Thus, when it is assumed that a natural number showing the up-and-downsub-pixel pairs connected to one scanning line in the horizontaldirection (extending direction of the scanning lines) is “p”, the columnnumber of the input image data is also “p”. In FIG. 8, on theodd-numbered scanning lines, p=1 shows the up-and-down sub-pixel pair onthe second column connected to the odd-numbered scanning line, p=2 showsthe up-and-down sub-pixel pair on the fourth column, p=3 shows theup-and-down sub-pixel pair on the sixth column, p=4 shows theup-and-down sub-pixel pair on the eighth column, p=5 shows theup-and-down sub-pixel pair on the tenth column, and p=6 shows theup-and-down sub-pixel pair on the twelfth column. On the even-numberedscanning lines, p=1 shows the up-and-down sub-pixel pair on the firstcolumn connected to the even-numbered scanning line, p=2 shows theup-and-down sub-pixel pair on the third column, p=3 shows theup-and-down sub-pixel pair on the fifth column, p=4 shows theup-and-down sub-pixel pair on the seventh column, p=5 shows theup-and-down sub-pixel pair on the ninth column, and p=6 shows theup-and-down sub-pixel pair on the eleventh column.

When “p” is employed to the case of FIG. 18, the following applies forthe scanning line G2.

L (2p−1)=M2 (1, p) G

L (2p)=M2 (1, p) R

Further, the following applies for the scanning line G3.

L (2p−1)=M1 (1, p) G

L (2p)=M1 (1, p) B

That is, “2p−1” and “2p” correspond to the order of two data linesconnected to the up-and-down sub-pixel pair, and correspond to the colorof the upward sub-pixel or the downward sub-pixel. As shown in FIG. 4and FIG. 5, the order of data lines connected to the upward sub-pixeland the downward sub-pixel is determined depending on the structure ofthe up-and-down sub-pixel pairs (P2R/P2L). “Dx” and “Dx+1” which showthe order of data lines connected to the up-and-down sub-pixel pairshown in FIG. 4 and FIG. 5 can be replaced with “Dx=2p−1” and “Dx+1=2p”.That is, with the structure of P2R, the downward pixel corresponds to“2p−1” and the upward pixel corresponds to “2p”. In the meantime, withthe structure of P2L, the upward pixel corresponds to “2p−1” and thedownward pixel corresponds to “2p”.

Thus, information of the up-and-down sub-pixel pairs connected toarbitrary scanning lines is required. There is provided a lookup tablein which the scanning line is Gy, the up-and-down sub-pixel pairconnected to Gy is expressed as LUT (Gy, p), and the table returns “0”for P2R and “1” for P2L according to the structure of the up-and-downsub-pixel pairs.

As specific examples of LUT (Gy, p), FIG. 27 shows the lookup tablescorresponded to the layout pattern 3 of FIG. 10 and the layout pattern 4of FIG. 11. The use of LUT (Gy, p) makes it possible to know the orderof the upward pixel and the downward pixel in an arbitrary up-and-downsub-pixel pair. Thus, based on the regularity of the scanning linesshown in FIG. 25, the order of two colors can be designated by using thecolor C1 of the upward sub-pixel and the color C2 of the downwardsub-pixel. The lookup tables LUT (Gy, p) shown in FIG. 27 are expressedwith the sub-pixel pair number (p) connected to all the scanning linesof the display part. However, it is also possible to pay attention tothe repeated pattern, and to compress the table by using lower bits byexpressing Gy and p in binary numbers as shown in FIG. 28.

As described above, it is possible to designate the viewpoints, rownumbers, column numbers, and colors of input images corresponding to thedata L(1), L(2), - - - , L(n) for one arbitrary scanning line Gy byusing “p” and LUT (Gy, p).

The synthesized image data CM is completed by having the data from L(1)to L(n) as the data for one arbitrary scanning line corresponded to thedata lines D1, D2, - - - , Dn, Dn+1.

Regarding the relation between even/odd of the scanning lines and thedata lines connected to the sub-pixels is determined whether thesub-pixel located on the first row of the first column on the displaypart is the upward sub-pixel or the downward sub-pixel. FIG. 26 showsthe relation between even/odd of the scanning lines and the data linesto be connected to the sub-pixels by using the variable “u” which showswhether the sub-pixel positioned on the first row of the first column isthe upward sub-pixel or the downward sub-pixel. As shown in FIG. 26,when u=0, the data lines from D2 to Dn+1 are connected to the sub-pixelswhen the scanning lines are of odd-numbers, and the scanning line D1 isunconnected. Similarly, when u=0, the data lines from D1 to Dn areconnected to the sub-pixels when the scanning lines are of even-numbers,and the scanning line Dn+1 is unconnected. When u=1, even/odd of thescanning lines are inverted.

The synthesized image CM is completed by supplying the data from L(1) toL(n) for one scanning line to the data lines according to FIG. 26 as inthe followings.

In a case where “u=0” and the scanning lines are of odd numbers, thesynthesized images are as follows.

CM (Gy, 1)=z

CM (Gy, 2)=L(1)

CM (Gy, 3)=L(2)

- - -

CM (Gy, n)=L(n−1)

CM (Gy, n+1)=L(n)

In a case where “u=0” and the scanning lines are of even numbers, thesynthesized images are as follows.

CM (Gy, 1)=L(1)

CM (Gy, 2)=L(2)

CM (Gy, 3)=L(3)

- - -

CM (Gy, n)=L(n)

CM (Gy, n+1)=z

Note that “z” is the data supplied to the data line that is notconnected to the sub-pixel.

As described above, it is possible to generate the synthesized imagedata based on the information and the regularities. FIG. 29 showsspecific examples of the parameter variables required for generating thesynthesized image data and specific examples of the variable contents.At least one set of the parameters shown in FIG. 29 is saved in theparameter storage device 140 shown in FIG. 2. Through saving theparameters required for generating the synthesized image data, it ispossible to correspond to changes in the design of the display part bychanging the parameters. It is also possible to save a plurality ofparameters, and switch the parameters according to the display panel tobe connected.

(Explanations of Actions)

Actions of the exemplary embodiment will be described by referring tothe drawings.

FIG. 30 is a flowchart showing one-frame display action of the displaydevice according to the exemplary embodiment.

(Step S1000)

When the action of the display device according to the exemplaryembodiment is started, the parameters required for generating thesynthesized image, i.e., the viewpoint v1 of the input image to whichthe odd-numbered scanning line corresponds, the viewpoint v2 of theinput image to which the even-numbered scanning line corresponds, colorsCL1, CL2, CL3 of the color filters from the first row to the third row,the row number “m” and the column number “n” having a sub-pixel of thedisplay part 50 as a unit, the facing direction “u” of the sub-pixelpositioned on the first row of the first column of the display part 50,and the layout LUT of the up-and-down sub-pixel pairs of the displaypart 50, are set to the readout control device 130 from the parameterstorage device 140 shown in FIG. 2.

(Step S1100)

The image data M1, M2 for each viewpoint configured with image data ofi-rows and j-columns and the synchronous signals are inputted to thewriting control device 110 from outside. The writing control devicegenerates addresses which make it possible to discriminate each of thepixel data from M1 (1, 1) RGB to M1 (i, j) RGB and from M2 (1, 1) RGB toM2 (i, j) RGB which configure the input image data by utilizing thesynchronous signals, and stores the image data and the addresses thereofto the image memory 120. The image memory 120 has regions for twoscreens of the synthesized image data to be outputted, and alternatelyuses the readout screen region and the write screen region.

(Step S1200)

The input image data M1 and M2 stored in the image memory 120 are readout according to a prescribed pattern, rearranging processing isperformed, and the synthesized image data CM is outputted to thedata-line driving circuit 80 of the display panel 20. The actions of thereadout and rearranging processing will be described separately byreferring to a flowchart shown in FIG. 31.

(Step S2300)

When the readout and rearranging processing is completed, the one-framedisplay action is completed. The procedure is returned to step S1100,and the above-described actions are repeated.

FIG. 30 is a flowchart of actions for a region of one screen within theimage memory. As described in step S1100, the image memory 120 has theregions for two screens. Therefore, actually, the writing processing andthe readout and rearranging processing are executed in parallel.

Next, details of the readout and rearranging processing will bedescribed by referring to FIG. 31. FIG. 31 is a flowchart showing theprocessing contents of step S1200, which shows the processing for eachof the scanning lines from G1 to Gm.

(Step S1300)

“1” is given to the variables “Gy”, “s”, and “q” as an initial value.“Gy” is the variable for counting the number of scanning lines, and thecount value corresponds to the scanning line for performing scanning.Further, “s” is the variable for counting the cycle of six scanninglines shown in FIG. 25, and “q” is the variable that is incremented by 1every time “s” counts 6.

(Step S1400)

This is the data processing part for the data of the top line, i.e., thesub-pixels connected to G1. The detailed contents of the processing ofthe top line will be described separately by referring to a flowchartshown in FIG. 32. Here, n-pieces of data including the data supplied tothe sub-pixels selected by the first scanning line are stored in a linebuffer.

(Step S1500)

The data stored in the line buffer for one scanning line is outputted tothe data-line driving circuit 80. The detailed contents of the outputprocessing will be described separately by referring to a flowchartshown in FIG. 33. In the output processing, processing for making then-pieces of data stored in the line buffer corresponded to the data linefrom D1 to Dn+1 is executed to complete the synthesized image data CM ofthe scanning line Gy, and the synthesized image data CM is outputted tothe data-line driving circuit 80.

(Step S1600)

The count values of “s” and “Gy” are incremented by 1 according to thehorizontal synchronous signals from the timing control device 150 shownin FIG. 2.

(Step S1700)

It is judged whether or not the count value of Gy is the last scanningline Gn+1 of the display part. For the judgment, the row number “m” ofthe display part set in step S1000 is used. When it has not reached to“m+1”, it is judged as Yes and the procedure is advanced to step S1800.When it is “m+1”, the judgment is No and the procedure is advanced tostep S2100.

(Step S1800)

It is the data processing part of the data of the sub-pixels connectedto the scanning line Gy except the top line G1 and the last line Gm+1.The detailed contents of the processing of the main line will bedescribed separately by referring to a flowchart shown in FIG. 32. Here,n-pieces of data including the data supplied to the sub-pixels selectedby the scanning line Gy are stored in the line buffer. When theprocessing of step S1800 ends, the procedure is advanced to the outputprocessing of step S1500 where the synthesized image data CM of thescanning line Gy is completed, and the synthesized image data CM isoutputted to the data-line driving circuit 80. When the processing ofstep S1500 ends, the procedure is advanced to step S2000.

(Step S2000)

Judgment by the count value of “s” is executed. When “s” has not reachedto 6, it is judged as Yes and the procedure is advanced to step S1600.When “s” is 6, the judgment is No and the procedure is advanced to stepS2000.

(Step S2100)

The count value of “s” is returned to “0”, the count value of “q” isincremented by 1, and the procedure is advanced to step S1600.

(Step S2200)

This is the data processing part for the data of the last line, i.e.,the sub-pixels connected to Gm+1. The detailed contents of theprocessing of the last line will be described separately by referring toa flowchart shown in FIG. 36. Here, n-pieces of data including the datasupplied to the sub-pixels selected by the (m+1)-th line are stored inthe line buffer. When the processing of step S2100 ends, the procedureis advanced to the output processing of step S1500 where the synthesizedimage data CM of the scanning line Gm+1 is completed, and thesynthesized image data CM is outputted to the data-line driving circuit80.

When the output processing of step S1500 following the processing ofstep S2200 ends, the readout and rearranging processing is completed.

Next, details of the top line processing will be described by referringto FIG. 32. With the top line processing, the input image datacorresponding to the scanning line G1 is read out and stored in areadout line buffer L. In the line buffer L, the n-pieces of sub-pixeldata for one row of the display part is stored to L(1), L(2), - - - ,L(n).

(Step S1410)

“1” is given to the variable “p” as an initial value. The variable “p”is used for designating the up-and-down sub-pixel pair connected to thescanning line G1, for designating the column number of the pixel data tobe read out, and for designating the order for storing the data in theline buffer.

(Step S1420)

It is judged whether the sub-pixel connected to the earliest order dataline among the data lines is the upward sub-pixel or the downwardsub-pixel of the up-and-down sub-pixel pair by using LUT. When LUT (1,p)=1, i.e., when the up-and-down sub-pixel pair connected to the p-thscanning line G1 is P2L, it is judged as Yes and the procedure isadvanced to step S1430. When LUT (1, p)=0, i.e., when the up-and-downsub-pixel pair connected to the p-th scanning line G1 is P2R, it isjudged as No and the procedure is advanced to step S1450.

(Step S1430)

The data supplied to the upward sub-pixel of the earliest order of dataline that is connected to the up-and-down sub-pixel pair P2L is storedin the line memory L (2p−1). On the top line, i.e., on the scanning lineG1, there is no upward sub-pixel as can be seen from the layout patternsof FIG. 8-FIG. 11 and FIG. 17 illustrated as the specific examples.Therefore, “z” is stored, even though the data stored in L (2p−1) is notreflected upon the display. Here, “z” is set as “0” as a way of example.

(Step S1440)

Following step S1430, the data supplied to the downward sub-pixel of thelast order of data line that is connected to the up-and-down sub-pixelpair P2L is stored in the line memory L (2p). First, the matrix andcolor of the pixel data of the input image to be read out with “M (v1)(1, p) (CL1)” are designated. Note here that “v1” is the parameter ofthe viewpoint image of the scanning line G1 (i.e., the odd-numberedscanning line). Since it is the scanning line G1, the row number is “1”,the column number is the variable “p”, and CL1 is the parameter of thecolor on the first row. Then, a readout address is decoded from “M (v1)(1, p) (CL1)”, and the data is read out from the image memory and storedto PD. This data PD is stored to the line memory L (2p).

(Step S1450)

The data supplied to the downward sub-pixel of the earliest order ofdata line that is connected to the up-and-down sub-pixel pair P2R isstored in the line memory L (2p−1). As in the case of step S1440, thematrix and color of the pixel data of the input image to be read out aredesignated by “M (v1) (1, p) (CL1)”. Then, a readout address is decodedfrom M (v1) (1, p) (CL1), and it is stored to a PD from the imagememory. This data PD is stored to the line memory L (2p−1).

(Step S1460)

Following step S1450, the data supplied to the upward sub-pixel of thelast order of data line that is connected to the up-and-down sub-pixelpair P2R is stored in the line memory L (2p). On the scanning line G1,there is no upward sub-pixel as described in the section of step S1430.

Therefore, “z” is stored even though the data stored in L (2p) is notreflected upon the display. Here, “z” is set as “0” as a way of example.

(Step S1470)

It is judged whether or not the processing of the up-and-down sub-pixelpairs for one scanning line has been completed based on the count valueof “p”. For the judgment, the column number “n” of the display part setin step S1000 is used. When the count value “p” has not reached to“n+2”, it is judged as Yes and the procedure is advanced to step S1480.When it is “n+2”, the judgment is No and the procedure for the top lineis ended.

(Step S1480)

The count value of “p” is incremented by 1, and the procedure isadvanced to step S1420.

Next, details of the output processing will be described by referring toFIG. 33. In the output processing, processing for having the n-pieces ofdata stored in the line buffer L corresponded to the data lines from D1to Dn or from D2 to Dn+1 is executed to complete the synthesized imagedata CM, and the synthesized image data CM is outputted to the data-linedriving circuit 80.

(Step S1510)

This shows that the value of Gy used in the readout and rearrangingprocessing is continuously used and the line buffer L to which the datais stored in the readout and rearranging processing is used, and it isnot a step which executes any special processing.

(Step S1520)

“1” is given to “x” as an initial value. Note here that “x” s used todesignate the order of the data lines, i.e., used to designate thecolumns of the synthesized image data CM. It is a count value of a datatransfer clock for the data-line driving circuit 80, which is generatedby the timing control device 150 shown in FIG. 2.

(Step S1530)

It is judged whether or not the first data line D1 is connected to thesub-pixel and used for display. For the judgment, the parameter “u” thatis the facing direction of the sub-pixel positioned on the first row ofthe first column of the display part 50 and the count value Gy of thescanning line set in step S1000 are used. As shown in FIG. 26, when u=0and the scanning line Gy is of an even number or when u=1 and thescanning line Gy is of an odd number, the data line D1 is used. Thus, itis judged as Yes, and procedure is advanced to step S1540. Whenunmatched to that condition, it is judged as No and the procedure isadvanced to step S1550.

(Step S1540)

It is judged whether or not the processing has reached to the last dataline Dn+1. For the judgment, the column number “n” of the display partset in step S1000 is used. When the count value of “x” has not reachedto “n+1”, it is judged as Yes and the procedure is advanced to stepS1541. When the count value of “x” is “n+1”, the judgment is No and theprocedure is advanced to step S1543.

(Step S1541)

The data L(x) of the line buffer is outputted to the synthesized imagedata CM (Gy, x). This synthesized image data is outputted to thedata-line driving circuit 80.

(Step S1542)

The count value of “x” is incremented by 1, and the procedure isadvanced to step S1540.

(Step S1543)

At this time, “X=n+1”. From judgment made in step S1530, there is nosub-pixel which is connected to the data lien Dn+1. Thus, even though itis not reflected upon display, “z” is outputted to the synthesized imagedata CM (Gy, n+1). Here, “z” is set as “0” as a way of example. Thissynthesized image data CM is outputted to the data-line driving circuit80. Thereby, the output of data up to the data line Dn+1 is completed,so that the output processing is ended.

(Step S1550)

It is judged whether or not the processing is for the first data lineD1. When “x=1”, it is judged as Yes and the procedure is advanced tostep S1551. When “x” is not 1, the judgment is No and the procedure isadvanced to step S1553.

(Step S1551)

At this time, “X=1”. From judgment made in step S1530, there is nosub-pixel which is connected to the data lien Dn+1. Thus, even though itis not reflected upon display, “z” is outputted to the synthesized imagedata CM (Gy, n+1). Here, “z” is set as “0” as an example. Thissynthesized image data CM is outputted to the data-line driving circuit80.

(Step S1552)

The count value of “x” is incremented by 1, and the procedure isadvanced to step S1550.

(Step S1553)

The data L(x−1) of the line buffer is outputted to the synthesized imagedata CM (Gy, x). This synthesized image data CM is outputted to thedata-line driving circuit 80.

(Step S1554)

It is judged whether or not the processing has reached to the last dataline Dn+1. When the count value of “x” has not reached to “n+1”, it isjudged as Yes and the procedure is advanced to step S1552. When thecount value of “x” is “n+1”, output of the data up to the data line Dn+1has been completed. Thus, it is judged as No, and the output processingis ended.

Next, details of the main line processing will be described by referringto FIG. 34. FIG. 34 is a flowchart showing the processing contents ofstep S1800. With the main line processing, the input image datacorresponding to the scanning line Gy is read out according to theregularity in a unit of scanning line shown in FIG. 25, and n-pieces ofsub-pixel data for one row are stored in the line buffer L. FIG. 34shows the processing executed according to the regularity shown in FIG.25, and the processing for storing the data to the line buffer will bedescribed separately by referring to FIG. 35.

(Step S1810)

This shows that the value of “Gy”, the value of “s”, and the value of“q” used in the readout and rearranging processing are continuouslyused, and it is not a step which executes any special processing.

(Step S1811-Step S1815)

Executed herein is divergence of the conditions based on the value of“s” which is the cycle of six scanning lines. According to the values of“x” from 1 to 6, the procedure is advanced to step S1821-step S1826.

(Step S1821-Step S1815)

As shown in FIG. 25, information of the viewpoint, color, and row fordesignating the pixel data to be read out is stored for the respectivevariables in accordance with the value of “s”. The viewpoint is storedas the variable k, the color of the upward sub-pixel is stored as thevariable C1, and the color of the downward sub-pixel is stored as thevariable C2 by using the parameters set in step S1000. Further, the rowof the input image of the upward sub-pixel is calculated and stored as avariable Ui, and the row of the input image of the downward sub-pixel iscalculated and stored as a variable Di based on “q”.

(Step S1900)

The data corresponding to the scanning line Gy is read out and stored tothe line buffer L by using the variables k, Ui, Di, C1, and C2. Detailsthereof will be separately described by referring to a flowchart shownin FIG. 35. After completing the line buffer processing, the main lineprocessing is ended.

Next, details of line buffer storage processing will be described byreferring to FIG. 35. FIG. 35 is a flowchart showing the processingcontents of step S1900.

(Step S1910)

This shows that the value of Gy is continuously used and the variablesk, Ui, Di, C1, and C2 are also used, and it is not a step which executesany special processing.

(Step S1920)

“1” is given to the variable “p” as an initial value. The variable “p”is used for designating the up-and-down sub-pixel pair connected to thescanning line G1, for designating the column number of the pixel data tobe read out, and for designating the order for storing the data in theline buffer.

(Step S1930)

It is judged whether the sub-pixel connected to the earliest order dataline among the data lines is the upward sub-pixel or the downwardsub-pixel of the up-and-down sub-pixel pair by using LUT. When LUT (Gy,p)=1, i.e., when the up-and-down sub-pixel pair connected to the p-thscanning line Gy is P2L, it is judged as Yes and the procedure isadvanced to step S1940. When LUT (Gy, p)=0, i.e., when the up-and-downsub-pixel pair connected to the p-th scanning line Gy is P2R, it isjudged as No and the procedure is advanced to step S1960.

(Step S1940)

The data supplied to the upward sub-pixel of the earliest order of dataline that is connected to the up-and-down sub-pixel pair P2L is storedin the line memory L (2p−1). The viewpoint, matrix, and color of thepixel data of the input image to be read out are designated by “M(k),(Ui, p) (C1)”. Then, a readout address is decoded, and the data is readout to PD from the image memory. This data PD is stored to the linememory L (2p−1).

(Step S1950)

Following step S1940, the data supplied to the downward sub-pixel of thelast order of data line that is connected to the up-and-down sub-pixelpair P2L is stored in the line memory L (2p). The viewpoint, matrix, andcolor of the pixel data of the input image to be read out are designatedby M(k), (Di, p) (C2). Then, a readout address is decoded, and the datais read out to PD from the image memory. This data PD is stored to theline memory L (2p). The procedure is advanced to step S1980.

(Step S1960)

The data supplied to the downward sub-pixel of the earliest order ofdata line that is connected to the up-and-down sub-pixel pair P2R isstored in the line memory L (2p−1). The viewpoint, matrix, and color ofthe pixel data of the input image to read out are designated by M(k),(Di, p) (C2). Then, a readout address is decoded, and the data is readout to PD from the image memory. This data PD is stored to the linememory L (2p−1).

(Step S1970)

Following step S1960, the data supplied to the upward sub-pixel of thelast order of data line that is connected to the up-and-down sub-pixelpair P2R is stored in the line memory L (2p). The viewpoint, matrix, andcolor of the pixel data of the input image to be read out are designatedby M(k), (Ui, p) (C1). Then, a readout address is decoded, and the datais read out to PD from the image memory. This data PD is stored to theline memory L (2p). The procedure is advanced to step S1980.

(Step S1980)

It is judged whether or not the processing of the up-and-down sub-pixelpairs for one scanning line has been completed based on the count valueof “p”. For the judgment, the column number “n” of the display part setin step S1000 is used. When the count value “p” has not reached to“n÷2”, it is judged as Yes and the procedure is advanced to step S1990.When it is “n÷2”, the judgment is No and the line buffer storageprocessing is ended.

(Step S1990)

The count value of “p” is incremented by 1, and the procedure isadvanced to step S1930.

Next, details of the last line processing will be described by referringto FIG. 36. FIG. 36 is a flowchart showing the processing contents ofstep S2200 shown in FIG. 31. With the last line processing, the inputimage data corresponding to the scanning line Gm+1 is read out, and itis stored in the line buffer L.

(Step S2210)

This shows that the value of “Gy”, the value of “s”, and the value of“q” used in the readout and rearranging processing are continuouslyused, and it is not a step which executes any special processing.

(Step S2211)

Executed is divergence of the conditions based on the value of “s” whichis the cycle of six scanning lines. The value of “x” on the lastscanning line Gm+1 of the display part becomes s=1 or s=4 since thesub-pixels of the exemplary embodiment are of three colors R/G/B. Whenit is s=1, the judgment is Yes and the procedure is advanced to stepS2212. When it is s=4, the judgment is No and the procedure is advancedto step S2213.

(Step S2212, Step S2213)

As shown in FIG. 25, information of the viewpoint, color, and row fordesignating the pixel data to be read out is stored as the respectivevariables in accordance with the value of “s”. The viewpoint is storedas the variable k, the color of the upward sub-pixel is stored as thevariable C1, and the color of the downward sub-pixel is stored as thevariable C2 by using the parameters set in step S1000. Further, the rowof the input image of the upward sub-pixel is calculated and stored as avariable Ui, and the row of the input image of the downward sub-pixel iscalculated and stored as a variable Di based on “q”. The procedure isadvanced to step S2220.

(Step S2220)

“1” is given to the variable “p” as an initial value. The variable “p”is used for designating the up-and-down sub-pixel pair connected to thescanning line Gm+1, for designating the column number of the pixel datato be read out, and for designating the order for storing the data inthe line buffer.

(Step S2230)

It is judged whether the sub-pixel connected to the earliest order dataline among the data lines is the upward sub-pixel or the downwardsub-pixel of the up-and-down sub-pixel pair by using LUT. When LUT (Gy,p)=1, i.e., when the up-and-down sub-pixel pair connected to the p-thscanning line Gy is P2L, it is judged as Yes and the procedure isadvanced to step S2240. When LUT (Gy, p)=0, i.e., when the up-and-downsub-pixel pair connected to the p-th scanning line Gy is P2R, it isjudged as No and the procedure is advanced to step S2260.

(Step S2240)

The data supplied to the upward sub-pixel of the earliest order of dataline that is connected to the up-and-down sub-pixel pair P2L is storedin the line memory L (2p−1). The viewpoint, matrix, and color of thepixel data of the input image to be read out are designated by M(k),(Ui, p) (C1). Then, a readout address is decoded, and the data is readout to PD from the image memory. This data PD is stored to the linememory L (2p−1).

(Step S2250)

Following step S2240, the data supplied to the downward sub-pixel of thelast order of data line that is connected to the up-and-down sub-pixelpair P2L is stored in the line memory L (2p). However, as can be seenfrom the layout patterns of FIG. 8-FIG. 11 and FIG. 17 illustrated asthe specific examples, there is no downward sub-pixel on the scanningline Gm+1. Therefore, “z” is stored even though the data stored in L(2p) is not reflected upon the display. Here, “z” is set as “0” as a wayof example. The procedure is advanced to step S2280.

(Step S2260)

The data supplied to the downward sub-pixel of the earliest order ofdata line that is connected to the up-and-down sub-pixel pair P2R isstored in the line memory L (2p−1). However, as described in the sectionof step S2250, there is no downward sub-pixel on the scanning line Gm+1.Therefore, “z” is stored even though the data stored in L (2p−1) is notreflected upon the display. Here, “z” is set as “0” as a way of example.

(Step S2270)

Following step S2260, the data supplied to the upward sub-pixel of thelast order of data line that is connected to the up-and-down sub-pixelpair P2R is stored in the line memory L (2p). The viewpoint, matrix, andcolor of the pixel data of the input image to be read out are designatedby M(k), (Ui, p) (C1). Then, a readout address is decoded, and the datais read out to PD from the image memory. This data PD is stored to theline memory L (2p). The procedure is advanced to step S2280.

(Step S2280)

It is judged whether or not the processing of the up-and-down sub-pixelpairs for one scanning line has been completed based on the count valueof “p”. For the judgment, the column number “n” of the display part setin step S1000 is used. When the count value “p” has not reached to“n÷2”, it is judged as Yes and the procedure is advanced to step S2290.When it is “n÷2”, the judgment is No and the last line processing isended.

(Step S2290)

The count value of “p” is incremented by 1, and the procedure isadvanced to step S2230.

As described, through executing the processing of the flowcharts shownin FIG. 30-FIG. 36, it becomes possible to generate the image data CM bysynthesizing image data and rearranging the pixel data from the imagedata for two viewpoints inputted from outside by applying the regularityin a unit of six scanning lines and the layout pattern of theup-and-down sub-pixel pairs, and to display the image data CM on thedisplay panel. The processing of the exemplary embodiment describedabove is merely an example, and the processing is not limited only tothat. For example, since there is no input image data corresponding toNP, the processing for the top line and the last line where there is theup-and-down sub-pixel pair including NP is executed as separateprocessing from the main processing. However, the input image data iswritten to the image memory, and the data for generating the image dataCM is read out by designating the addresses to the image memory. This,when it is possible to designate the address of the outside the inputimage data region and possible to read out the data corresponding to NP,the processing of NP can be executed with the main processing. The datasupplied to NP is invalid for the display. Thus, if the processing fordesignating the address of NP can be executed, the main line processingcan also be applied as it is without separating the processing for thetop and last lines.

Regarding the output from the line buffer to the data-line drivingcircuit, described is the processing flow which outputs the data forevery sub-pixel data. However, it depends on the interfacespecifications of the data-line driving circuit. For example, the datamay be outputted from the line buffer by a unit of three sub-pixels orby a unit of six sub-pixels.

The structures and the actions of the first exemplary embodiment havebeen described heretofore.

FIG. 37 is a block diagram showing a terminal device that is an exampleto which the display device of the exemplary embodiment is applied. Theterminal device 300A shown in FIG. 37A is configured, including an inputdevice 301, a storage device 302, an arithmetic calculator 303, anexternal interface 304, a display device 305A of the exemplaryembodiment, and the like. As described above, the display device 305Aincludes a display controller 100, so that data for two images may betransmitted as in a case where the image data is transmitted from thearithmetic calculator 303 to a typical display device. The two pieces ofimage data may be the image data which is displayed two dimensionally ona typical display panel. That is, the display device 305A of theexemplary embodiment includes the display controller 100, so that thearithmetic calculator 303 does not need to execute some kind ofprocessing on the two pieces of image data to be outputted. Thus, thereis no load imposed upon the arithmetic calculator 303 in this respect.Further, the display controller 100 of the exemplary embodiment includesan image memory 120 (FIG. 2). Thus, the two pieces of image dataoutputted by the arithmetic calculator 303 are not limited to be in aform where the image data are lined in the horizontal direction whoseimage is shown in FIG. 37 (the so-called side-by-side form), but may bein a form where the image data are lined in the vertical direction (theso-called dot-by-dot form) or in a frame sequential form.

A terminal device 300B shown in FIG. 37(B) is in a structure in which adisplay module 200B is different from that of the terminal device 300A.For example, the display module 200B is different from the displaymodule 200A in terms of the layout of the image separating device, theorder of the color filters, the layout patterns of the up-and-downsub-pixel pairs, and the like. Specifications of the display modules200A and 200B are determined depending on the various factors requiredto the display devices 305A, 305B from the terminal devices 300A, 300Bto be loaded, respectively, such as the image quality, cost, size, andresolution. When the display module 200A is changed to the displaymodule 200B, the synthesized image data to be inputted to the displaymodule 200B needs to be changed. However, as described above, thedisplay device 305B of the exemplary embodiment includes the parameterstorage device 140 (FIG. 2) which is provided to the display controller100. Thus, even when the display module is changed to the display module200B, the same display controller 100 can be used. This makes itpossible to decrease the number of designing steps for the displaydevices 305A, 305B, and to decrease the cost for the display devices305A, 305B.

While the exemplary embodiment has been described by referring to thecase of the stereoscopic display device which provides different imagesto both eyes of the observer, the present invention may also be appliedto a two-viewpoint display device which provides different imagesdepending on the observing positions.

Further, while the exemplary embodiment has been described by referringto the case where the lenticular lens is used for the optical imageseparating device and the lenticular lens is disposed on the observerside of the display panel, the lenticular lens may be disposed on theopposite side from the observer. Furthermore, as the optical imageseparating device, it is also possible to employ a parallax barrier.

Further, the display panel of the exemplary embodiment has beendescribed as the liquid crystal display panel using liquid crystalmolecules. However, as the liquid crystal display panel, not only atransmissive liquid crystal display panel but also a reflective liquidcrystal display panel, a transflective liquid crystal display panel, aslight-reflective liquid crystal display panel in which the ratio of thetransmissive region is larger than that of the reflective region, aslight-transmissive liquid crystal panel in which the ratio of thereflective region is larger than the transmissive region, and the likecan be applied. Further, the driving method of the display panel can beapplied to the TFT method in a preferable manner.

For the TFTs of the TFT method, not only those using amorphous silicon,low-temperature polysilicon, high-temperature polysilicon, singlecrystal silicon, but also those using an organic matter, oxide metalsuch as zinc oxide, and carbon nanotube can also be employed. Further,the present invention does not depend on the structures of the TFTs. Abottom gate type, a top gate type, a stagger type, an inverted staggertype, and the like can also be employed in a preferable manner.

Further, the exemplary embodiment has been described by referring to thecase where the sub-pixel of the up-and-down sub-pixel pairs is in asubstantially trapezoid shape. However, the shape of the sub-pixel isnot limited to the trapezoid, as long as it is a shape which canmaintain the optical property of the up-and-down sub-pixel pairs and theconnecting relation thereof with respect to the scanning lines and thedata lines. Other polygonal shapes may also be employed. For example,when the top side of the trapezoid described in the exemplary embodimentis shortened, the shape turns out as a triangle. Further, when theupward sub-pixel and the downward sub-pixel are rotationally symmetricby 180 degrees, a hexagonal shape, an octagonal shape, and the like withthe bent scanning lines may also be employed. Further, the display partof the exemplary embodiment has been described to be configured withm-rows of sub-pixels in the vertical direction and n-columns ofsub-pixels in the horizontal direction. However, the layout relation ofthe scanning lines and the data lines may be switched by arranging thesub-pixels in n-rows in the vertical direction and m-columns in thehorizontal direction.

Further, for the display panel, it is possible to employ those otherthan the liquid crystal type. For example, it is possible to employ anorganic electroluminescence display panel, an inorganicelectroluminescence display panel, a plasma display panel, a fieldemission display panel, or PALC (Plasma Address Liquid Crystal).

As an exemplary advantage according to the invention, it is possible tofind the scanning line and the data line connected to the sub-pixelarranged in an arbitrary row and an arbitrary column without actuallydesigning the layout, since the regularity in the connection patterns ofscanning lines and the data lines for the matrix of the sub-pixels hasfound. Further, synthesized image data can be easily generated from thefound regularity, the placing condition of the image separating device,the arranging order of the colors of the sub-pixels, the layout patternof the up-and-down sub-pixel pair as the minimum unit, and the like.This makes it possible to use the input image data in a same form asthat of a typical flat display device, so that there is no load (e.g.,being required to rearrange the output image data) imposed upon thedevice that employs the present invention. Furthermore, the presentinvention puts the condition for generating the synthesized image datainto parameters, and uses a device for storing the parameters. Thus,when there is a change in the display module, it simply needs to changethe parameters and does not need to change the video signal processingdevice. This makes it possible to decrease the number of designing stepsand to reduce the cost.

Further, the present invention includes the image separating devicewhich directs the light emitted from the sub-pixels to a plurality ofviewpoints, and it is possible with the present invention to use theinput image data in a same transfer form as that of a typical flatdisplay device for the display module in which the issues caused due tothe light-shield part and the like are suppressed. Therefore, it is notnecessary to execute rearranging processing of the image data and anyspecial processing for the transfer, so that there is no load imposedupon the arithmetic calculator, for example, which outputs the imagedata to the display device that employs the present invention.Furthermore, the conditions for generating the synthesized image data ismade into parameters, and the parameters are stored so as to be able tocorrespond to the changes in the display module by changing theparameters. Thus, it is unnecessary to change the video signalprocessing device, thereby making it possible to decrease the number ofdesigning steps and to reduce the cost.

(Second Exemplary Embodiment)

The structure of a display device according to a second exemplaryembodiment of the present invention will be described. It is a displaydevice which provides different images to a plurality of N-viewpoints,and it is a feature of this display device that N is 4 or larger while Nis 2 with the display device of the first exemplary embodiment.Hereinafter, the second exemplary embodiment will be described byreferring to a case of stereoscopic display device which providesdifferent images to four viewpoints (N=4).

First, the outline of the second exemplary embodiment will be describedby mainly referring to FIG. 44. A display controller 102 of thisexemplary embodiment further includes an input data rearranging device160 which rearranges viewpoint image data for four viewpoints or moreinputted from outside into viewpoint image for two viewpoints. A writingcontrol device 110 has a function of writing the viewpoint image datarearranged by the input data rearranging device 160 into the imagememory 120, instead of the viewpoint image inputted from outside.Hereinafter, the second exemplary embodiment will be described indetail.

The display part of the second exemplary embodiment is configured withup-and-down sub-pixel pairs whose structure and equivalent circuits areshown in FIG. 4 and FIG. 5. Explanations of the up-and-down sub-pixelpairs are omitted, since those are the same as the case of the firstexemplary embodiment.

FIG. 38 is an example showing the relation between the image separatingdevice and the display part according to the second exemplaryembodiment. Regarding the XY axes in the drawing, X shows the horizontaldirection and Y shows the vertical direction. Trapezoids arranged intwelve rows in the vertical direction and in twelve columns in thehorizontal direction are the sub-pixels, and shadings are the colors ina pattern in which R, G, and B are repeated in this order by each rowfrom the first row. As the image separating device, a cylindrical lens30 a configuring a lenticular lens 30 corresponds to a unit of fourcolumns of sub-pixels, and it is so arranged that the longitudinaldirection thereof becomes in parallel to the vertical direction so as toexhibit the lens effect for the horizontal direction. Light rays emittedfrom the sub-pixels are separated to different directions of four-columncycles in a column unit, and form four viewpoint images at positionsdistant from the lens plane due to the lens effect of the cylindricallenses 30 a. The pixel as the structural unit of each of the fourviewpoint images is configured with three sub-pixels of RGB lined in thevertical direction in a column unit. In FIG. 38, the pixel of the firstviewpoint image is shown as M1P, the pixel of the second viewpoint imageis shown as M2P, the pixel of the third viewpoint image is shown as M3P,and the pixel of the fourth viewpoint image is shown as M4P.

FIG. 39 shows an optical model of each viewpoint image formed by thelight rays emitted from the pixels M1P-M4P for each viewpoint. As shownin FIG. 39, the lenticular lens 30 is disposed on the observer side ofthe display panel, and also disposed in such a manner that the projectedimages from all M1P of the display part are superimposed at a plane awayfrom the lens plane by a distance OD, and also projected images fromM2P, M3P, and M4P are superimposed and the width of the superimposedprojected images in the X direction becomes the maximum. With thislayout, the regions of the first viewpoint image, the second viewpointimage, the third viewpoint image, and the fourth viewpoint image areformed in the horizontal direction in order from the left when viewedfrom the observer.

Next, the connecting relation regarding the sub-pixels shown in FIG. 38and scanning lines as well as data lines will be described. FIG. 40 isan example of the display part of the second exemplary embodiment shownin FIG. 38 which is configured with up-and-down sub-pixel pairs P2R andP2L. This is a pattern in which four columns configured with P2L andfour columns configured with P2R are repeated alternately, and it iscalled a layout pattern 6. The layout pattern 6 is capable of providinga high image quality when vertical 2-dot inversion drive is applied tothe polarity inversion driving method.

FIG. 41 shows the polarity distribution of the display part when thevertical 2-dot inversion drive is applied to the layout pattern 6 shownin FIG. 40, and shows the data line polarity for each scanning lineunder the vertical 2-dot inversion drive. As described in FIG. 38, withthe second exemplary embodiment, each viewpoint image is provided in afour-column cycle. As shown in FIG. 41, through alternately arrangingthe up-and-down sub-pixel pairs P2R and P2L in a four-column cycle bycorresponding to the periodicity of the viewpoint images, the polaritiesof the sub-pixels neighboring to each other in the horizontal directionare inverted in each of the separated viewpoint images. Further, for thepolarity distribution within the column, the polarities of thevertically-neighboring pixel electrodes of the up-and-down sub-pixelpairs P2L and the up-and-down sub-pixel pairs P2R become the samepolarities, and the polarities are inverted by every two rows. Thus, asin the case of FIG. 15 of the first exemplary embodiment, it is possibleto suppress abnormal alignment of the liquid crystal molecules in thevicinity of the bottom sides. Therefore, the effect for suppressingflickers is great, thereby making it possible to provide a high imagequality.

Next, described is synthesized image data that is supplied to thedisplay part of the second exemplary embodiment which is configured withthe layout pattern 6 and in which the imaging device is disposed as inFIG. 38. FIG. 42 shows image data for four viewpoints inputted fromoutside, and FIG. 43 shows synthesized image data of the layout pattern6, which is synthesized from the input data shown in FIG. 42. FIG. 42shows charts of the image data from the first viewpoint image data tothe fourth viewpoint image data configured with pixels of 4 rows×3columns. As described in FIG. 6 in the section of the first exemplaryembodiment, regarding “Mk (i, j) RGB”, “k” indicates the viewpoint, “i”is the row number within an image, “j” is the column number within theimage, and “RGB” means that it carries luminance information of each ofthe colors R: red, G: green, and B: blue.

As in the case of the first exemplary embodiment, the synthesized imagedata of FIG. 43 can be generated from the connection regularity of theup-and-down sub-pixel pairs in a unit of scanning line and theregularity in a unit of data line based on the image separating device,the setting parameters of the color layout of the color filters, and thesetting parameters of the layout patterns.

FIG. 44 shows a functional block diagram of the second exemplaryembodiment. As in the case of the first exemplary embodiment, it isconfigured with: a display controller 102 which generates synthesizedimage data CM from the image data for each viewpoint inputted fromoutside; and a display panel 20 which is a display device of thesynthesized image data CM. The structure of the display panel 20 is thesame as that of the first exemplary embodiment, so that explanationsthereof are omitted by applying the same reference numerals. Thestructure of the display panel 102 is different from that of the firstexemplary embodiment in respect that the second exemplary embodimentincludes the input data rearranging device 160. However, the otherstructural elements are the same, so that explanations thereof areomitted by applying the same reference numerals.

The input data rearranging device 160 performs processing forrearranging the image data for N-viewpoints (N=4 in FIG. 44) into a dataform of two input images as described in the first exemplary embodiment.A specific example will be described by referring to FIG. 45.

As shown in FIG. 45, “M1′ (i, j′) RGB” is generated from the firstviewpoint image M1 and the third viewpoint image, and “M2′ (i, j′) RGB”is generated from the second viewpoint image and the fourth viewpointimage, respectively. Those are rearranged in a column unit, andfollowings are obtained.

M1′ (i, 1) RGB=M3 (i, 1) RGB

M1′ (i, 2) RGB=M1 (i, 1) RGB,

M1′ (i, 3) RGB=M3 (i, 2) RGB,

- - -

M1′ (i, 6) RGB=M1 (i, 3) RGB

Similarly, rearrangement is done as follows.

M2′ (i, 1) RGB=M4 (i, 1) RGB

M2′ (i, 2) RGB=M2 (i, 1) RGB

M2′ (i, 3) RGB=M4 (i, 2) RGB

- - -

M2′ (i, 6) RGB=M2 (i, 3) RGB

By transmitting the image data “M1′(i, j′) RGB” and “M2′(i, j′) RGB”generated in this manner to the writing control device 110, thesynthesized image data shown in FIG. 43 can be generated though theprocessing actions described in the first exemplary embodiment.

In FIG. 44, the input data rearranging device 160 is illustratedseparately from the writing control device 110. However, it is soillustrated to describe the structure, and the input data rearrangingdevice 160 may be included in the writing control device 110. This isbecause the same processing as the input data rearranging processingshown in the drawing can be executed through controlling the generatedaddresses by a column unit of each viewpoint image by the writingcontrol device 110.

Further, while the stereoscopic display device which provides differentimages for the four viewpoints (N=4) has been described as the exampleof the second exemplary embodiment, the number of viewpoint is notlimited to be four. It is possible to be applied to a still largernumber of viewpoints.

(Effects)

As shown in FIG. 39, the number of viewpoints can be increased with thesecond exemplary embodiment. Thus, the observer can enjoy stereoscopicimages from different angles by changing the observing positions.Further, motion parallax is also provided at the same time, which cangive a higher stereoscopic effect to the images.

(Third Exemplary Embodiment)

The structure of a display device according to a third exemplaryembodiment of the present invention will be described.

FIG. 46 is a functional block diagram of the third exemplary embodiment.The third exemplary embodiment is different from the first exemplaryembodiment in respect that a display panel 23 includes a data-lineselecting switch 170 which is controlled by a data-line selection signal171 outputted from a readout control device 133 of a display controller130. Other structural elements are the same as those of the firstexemplary embodiment, so that explanations thereof are omitted byapplying the same reference numerals. The data-line selecting switch 170has a function of switching n-pieces of outputs of a data-line drivingcircuit 83 to data lines D1 -Dn or D2-Dn+1 of a display part 50. Withthe use of this function, the data processing for making the n-pieces ofdata stored in the line buffer corresponded to the data lines D1-Dn orD2-Dn+1, which is executed in the output processing described in theflowchart shown in FIG. 32 of the first exemplary embodiment, becomesunnecessary. That is, with the third exemplary embodiment, the n-piecesof data stored in the line buffer may be outputted directly to thedata-line driving circuit, and the switching signal may be supplied tothe data-line selection signal 171. Thus, the synthesized image data isin a data structure of (Gm+1) rows×n columns.

It is also possible to add the structure of the second exemplaryembodiment to the structure of the third exemplary embodiment describedabove to make it into a multi-viewpoint device.

(Effects)

With the third exemplary embodiment, the processing of the readoutcontrol device can be omitted. Thus, the circuit scale of the displaycontroller 103 can be reduced compared to that of the first exemplaryembodiment. Further, when a drive IC is used for the data-line drivingcircuit 83, it only needs to have n-pieces of outputs, which is the samenumber as the column number of the sub-pixels configuring the displaypart. An alternative for using the drive IC can be increased, so thatthere is an effect of making it possible to reduce the cost.

(Fourth Exemplary Embodiment)

The structure of a display device according to a fourth exemplaryembodiment of the present invention will be described. It is astereoscopic display device which includes one more image separatingdevice in addition to the structure of the first exemplary embodiment.

First, the outline of the fourth exemplary embodiment will be describedby mainly referring to FIG. 47 and FIG. 48. A display controller 104 ofthis exemplary embodiment further includes an input datavertical-lateral conversion device 164 which rearranges viewpoint imagedata inputted from outside into an image that is rotated by 90 degreesclockwise or counterclockwise. A display module 201 includes a secondimage separating device configured with an electro-optic element 180,which directs light emitted from sub-pixels 40 to a plurality ofviewpoints by a unit of sub-pixel 40. The direction connecting theplurality of viewpoints towards which the electro-optic element 180directs the light is orthogonal to the direction connecting theplurality of viewpoints towards which a lenticular lens 30 directs thelight. A writing control device 110 has a function of writing theviewpoint image data rearranged by the input data vertical-lateralconversion device 164 to an image memory 120, instead of the viewpointimage data inputted from outside. Hereinafter, the fourth exemplaryembodiment will be described in more detail.

FIG. 47 is an example showing the relation between the image separatingdevice and the display part according to the fourth exemplaryembodiment. Regarding the XY axes in the drawing, X shows the horizontaldirection and Y shows the vertical direction. In FIG. 47, sub-pixelsconfiguring the display part are shown with trapezoids which arearranged in twelve rows in the vertical direction and in twelve columnsin the horizontal direction. Shadings of the trapezoids showing thesub-pixels indicate the colors of the respective sub-pixels functioningby color filters, and an arrangement of three colors is repeated inorder of R, G, and B by each row from the first row. Connections betweenthe sub-pixels and the scanning lines as well as the data lines aredetermined depending on the layout of the up-and-down sub-pixel pairs asin the case of the first exemplary embodiment. The sub-pixel pitch ofevery two columns and the sub-pixel pitch of every three rows are equal.

As in the case of the first exemplary embodiment, the lenticular lens 30configured with cylindrical lenses 30 a is disposed on the observer sideof the display panel in such a manner that the lens effect is achievedin the horizontal direction and the light rays emitted from thesub-pixels on the even-numbered columns and odd-numbered columns areseparated towards different directions.

As the second image separating device, the electro-optic element 180which displays a parallax barrier pattern is disposed to the displaypanel on the opposite side of the observer. As the electro-optic element180, a transmissive liquid crystal panel is applicable, for example, andit is disposed in such a manner that the transmission part functioningas a slit 180 a becomes in parallel to the display panel when theparallax barrier pattern is displayed. Further, it is disposed in such amanner that the light rays emitted from the sub-pixels on theeven-numbered rows and the odd-numbered rows are separated towardsdifferent directions when the parallax barrier pattern is displayed.That is, it is so disposed that, when the display panel is rotated by 90degrees clockwise from the position of FIG. 46 in a state where botheyes of the observer are located in the horizontal direction, theodd-numbered rows function as the right-eye sub-pixels: R, and theeven-numbered rows function as the left-eye sub-pixels: L. In thedrawing, the slits 180 a are illustrated with shading for highlight forconvenience. When the electro-optic element 180 actually displays abarrier pattern, the shaded parts (slits 180 a) are the transmissionparts, and the other parts are the light-shield parts. When the displaypanel is rotated by 90 degrees counterclockwise from the observer side,R and L showing the functions of the sub-pixels are switched.

FIG. 48 shows a functional block diagram of the fourth exemplaryembodiment. It is different from the first exemplary embodiment inrespect that the display controller 104 includes the input datavertical-lateral conversion device 164 and an image separation controldevice 190. Other structural elements are the same as those of the firstexemplary embodiment, so that explanations thereof are omitted byapplying the same reference numerals. Further, the structure of thesub-pixels 40 configuring the display part is the same as the structureof the up-and-down sub-pixel pairs described in FIG. 4 and FIG. 5 of thefirst exemplary embodiment, and the layout of the display part 50 isalso formed with the up-and-down sub-pixel pairs as in the case of thefirst exemplary embodiment.

The input data vertical-lateral conversion device 164 performsprocessing for converting the image data M1 and M2 inputted from outsideinto a data form of two input images as described in the first exemplaryembodiment, when the display panel is rotated by 90 degrees.

The image separation control device 190 controls display/non-display ofthe barrier pattern shown in FIG. 47 on the second image separatingdevice (not shown) according to the control signal to be inputted.

The vertical-lateral conversion executed by the input datavertical-lateral conversion device 164 will be described by referring tothe drawing.

FIG. 49 shows charts for describing the processing of a case where thebarrier pattern is not displayed when the display panel is rotated by 90degrees, i.e., a case of flat display. The display panel shown in FIG.47 is configured with 4 rows×6 columns of a pixel unit carrying colorinformation. Thus, when the panel is rotated by 90 degrees clockwise, itturns out as a panel of 6 rows×4 columns. FIG. 49 shows an input imagedata rM of 6 rows×4 columns.

Since the display panel is rotated by 90 degrees clockwise, the inputdata vertical-lateral conversion device 164 rotates the rows and columnsof the input image data rM by 90 degrees counterclockwise to convert thedata rM into a data form (illustrated in the drawings in 4 rows×6columns) of two input images as described in the first exemplaryembodiment.

FIG. 49 shows the data “M1′ (i′, j′) RGB” and “M2′ (i′, j′) RGB”, whichare converted from the input image data rM. The data rM is rearranged asfollows.

M1′ (1, 1) RGB=rM (1, 4) RGB

M1′ (1, 2) RGB=rM (2, 4) RGB

M1′ (1, 3) RGB=rM (3, 4) RGB

- - -

M1′ (1, 6) RGB=rM (6, 4) RGB

M1′ (2, 1) RGB=rM (1, 3) RGB

- - -

M1′ (2, 6) RGB=rM (6, 3) RGB

- - -

M1′ (4, 6) RGB=rM (6, 1) RGB

“M2′ (i′, j′) RGB” is in the same data layout as that of “M1′ (i′, j′)RGB”.

By transmitting the image data “M1′ (i, j′) RGB” and “M2′ (i, j′) RGB”converted in this manner to the writing control device 110, thesynthesized image data shown in FIG. 48 can be generated according tothe display panel though the processing actions described in the firstexemplary embodiment. With the generated synthesized image, the inputimage rM can be displayed on the display panel shown in FIG. 47. Theobserver can observe the input image rM in a state where the displaypanel of FIG. 47 is rotated by 90 degrees clockwise.

Next, described is processing of a case where a barrier pattern isdisplayed while the display panel is rotated by 90 degrees clockwise,i.e. processing of a case where stereoscopic display is performed byusing the second image separating device. The display panel shown inFIG. 47 is configured with 4 rows×6 columns of pixel units which carriescolor information. With the barrier display, the sub-pixels neighboringalong the Y direction function as a left-eye sub-pixel and a right-eyesub-pixel alternately. Thus, the resolution in the Y direction becomesone half. That is, in the case of FIG. 47, the separated left-eye imageor right-eye image is an image of 6 rows×2 columns.

FIG. 50 shows the input image data for the display panel shown in FIG.47, i.e., the left-eye image data rM1 and the right-eye image data rM2.As shown in FIG. 50, in rM1 and rM2, the pixel data carrying the colorinformation of R: red, G: green, and B: blue are arranged in 6 rows×2columns. Since the display panel is rotated by 90 degrees clockwise, theinput data vertical-lateral conversion device 164 rotates the rows andcolumns of the input image data rM1 and rM2 by 90 degreescounterclockwise. At this time, the left-eye image data and theright-eye image data are arranged alternately in a color unit to besynthesized. As shown in FIG. 47, it is because the sub-pixels of eachcolor arranged in the Y direction become the sub-pixel for the left eyeand the sub-pixel for the right eye alternately in this case.Specifically, as shown in FIG. 47, regarding the pixel (1, 1) of the M1image, the sub-pixels on the tenth row of the first and second columnsbecome “rM1 (1, 1) R”, the sub-pixels on the eighth row of the first andsecond columns become “rM1 (1, 1) G”, and the sub-pixels on the twelfthrow of the first and second columns become “rM1 (1, 1) B”.

As described above, “rM1 rM2” synthesized image data shown in FIG. 50 isgenerated, and it is outputted as “M1′ (i′, j′) RGB” and “M2′ (i′, j′)RGB”, which suit the data form of two input images described in thefirst exemplary embodiment, to the writing control device 110.

The synthesized image data in accordance with the display panel isgenerated in this manner through the processing actions described in thefirst exemplary embodiment, and the synthesized image of the inputimages “Mr1Mr2” can be displayed on the display panel shown in FIG. 47.Thereby, when the input images “rM1rM2” are parallax images, theobserver can observe the stereoscopic display in a state where thedisplay panel of FIG. 47 is being rotated by 90 degrees clockwise.

In the above, the structures and actions of the fourth exemplaryembodiment have been described regarding the vertical-lateral conversionof the case where the display panel is rotated by 90 degrees clockwise.The exemplary embodiment is not limited only to the case of theclockwise 90-degree rotation but also applicable to the case ofcounterclockwise 90-degree rotation. In the case of counterclockwise90-degree rotation, the conversion of the rows and columns of the inputimage data executed in the case of the clockwise 90-degree rotation maybe changed from the clockwise 90-degree rotation to counterclockwise90-degree rotation.

(Effects)

In addition to the effects of the first exemplary embodiment, it ispossible with the fourth exemplary embodiment to enjoy the stereoscopicdisplay also when the display panel is rotated by 90 degrees.

(Fifth Exemplary Embodiment)

The structure of a display device according to a fifth exemplaryembodiment of the present invention will be described. The displaydevice according to the fifth exemplary embodiment is structured in aform in which the image memory provided to the display controlleraccording to the first exemplary embodiment is not formed by a framememory but by a plurality of line memories to reduce the memory regionprovided in the display controller.

FIG. 51 shows a functional block diagram of the fifth exemplaryembodiment. As in the case of the first exemplary embodiment, it isconfigured with: a display controller 105 which generates synthesizedimage data CM from image data for each viewpoint inputted from outside;and a display panel 20 which is a display device of the synthesizedimage data. The structure of the display panel 20 is the same as that ofthe first exemplary embodiment, so that explanations thereof are omittedby applying the same reference numerals. The display controller 105includes: a line memory 125; a writing control device 115 which has afunction of writing input image data to the line memory 125; a readoutcontrol device 135 which has a function of reading out the data from theline memory 125; and a timing control device 155 which generates eachcontrol signal by using an input synchronous signal. Other structuralelements of the display controller 105 are the same as those of thefirst exemplary embodiment, so that explanations thereof are omitted byapplying the same reference numerals.

As described, in the fifth exemplary embodiment, the image memory is notthe so-called frame memory with which all the input image data can bewritten and saved. Thus, there is a restriction in the transfer form ofthe input image data, and the timing between the input data and theoutput data. Actions of the fifth exemplary embodiment will be describedby referring to a timing chart shown in FIG. 52.

FIG. 52 is a chart showing timings when outputting the input image data(generating the synthesized image data) shown in FIG. 57 to the displaypart in the layout pattern 1 shown in FIG. 8 where the image separatingdevice shown in FIG. 7 is disposed. In the case of FIG. 52, as thetransfer form of the input image data, employed is the so-calledside-by-side form with which the image data for a plurality ofviewpoints are transferred by each row.

“T” shown in FIG. 52 shows one horizontal period of the display panel,input data M1 and M2 are pixel data of 4 rows×6 columns shown in FIG.57, and input data M1(1) and M2(1) indicate the first row of the firstviewpoint image data M1 and the second row of the second viewpoint imagedata M2. From L1 to L6 are line memories which can store one-row of eachinputted viewpoint image data, and L1, L3, L5 store the first viewpointimage data while L2, L4, L6 store the second viewpoint image data.Outputs G1, G2, - - - , G13 show the data outputs to the sub-pixelsconnected to each scanning line by corresponding to the scanning linenumber of the display part shown in FIG. 8. Three horizontal periods ofthe display panel output and the total periods of the input period forinputting one row of M1 and the input period for inputting one row of M2are set to be the same so as to uniformanize updates of input/outputimages by a frame unit. Even though not shown in the timing chart, theoutput horizontal period and the input periods described above arecycles of synchronous signals, and include the so-called blankingperiods where there is no valid data.

Details of the actions will be described by referring to FIG. 52. In theperiod of T1-T3, the input data M1(1) is stored to L1 and the input dataM2(1) is stored to L2. In T4, M1(2) is stored to L3 and, at the sametime, processing is executed for reading out data of the sub-pixel towhich the scanning line G1 is connected from L1 in which M1(1) isstored, as described in the first exemplary embodiment. Informationregarding the image separating device of FIG. 7 and the layout pattern 1of FIG. 8 stored in the parameter storage device 140 and the data M1(1)R which is determined based on the regularity and to be supplied to thescanning line G1 are readout from L1, processing is executed thereon,and it is outputted to the display panel. Similarly, in T5, the dataM2(1) R, G to be supplied to the scanning line G2 is read out from L2,processing is executed thereon, and it is outputted to the displaypanel. Further, in the middle of T5, a storing action of the input imagedata M2(2) to L4 is started. In T6, the data M1(1) G, B to be suppliedto the scanning line G3 is read out from L1, processing is executedthereon, and it is outputted to the display panel. In T7, M1(3) isstored to L5 and, at the same time, M2(1) B is read out from L2 andM2(2) R is readout from L4 as the data to be supplied to the scanningline G4, processing is executed thereon, and the data are outputted tothe display panel. In T8, the data M2(1) R, G to be supplied to thescanning line G5 is read out from L3, processing is executed thereon,and it is outputted to the display panel. Further, in the middle of T8,a storing action of the input image data M2(3) to L6 is started. In T9,the data M2(2) G, B to be supplied to the scanning line G6 is read outfrom L4, processing is executed thereon, and it is outputted to thedisplay panel. In T10, M1(4) is stored to L1. The reason that M1(4) canbe stored to L1 is that M1(1) stored in L1 is already read out in T6, sothat it is not necessary to keep M1(1) any longer. At the same time, inT10, M1(2) B is read out from L3 and M1(3) R is readout from L5 as thedata to be supplied to the scanning line G7, processing is executedthereon, and the data are outputted to the display panel. As shown inFIG. 52, the same processing is repeated for each scanning line, andoutput to the display panel is repeated in the manner described above.

As in the above, the fifth exemplary embodiment uses the line memoriesfrom L1 to L6 for the image memory. Thereby, as in the case of the firstexemplary embodiment, synthesized image data can be generated from theinformation saved in the parameter storage device and the regularity. Ashas been described earlier, readout action of M1(1) stored in L1 iscompleted in T6, so that it is possible to store M1(3) that is inputtedin T7 to L1. However, unlike this storing relation between storingaction of M1(1) to L1 and following storing action of M1(3), it is notpossible to store M1(4) to L3 following M1(2). This is because in T10where M1(4) is inputted, readout action of M1(2) B stored in L3 isexecuted simultaneously, as shown in FIG. 52. Thus, L5 for storing M1(3)is provided, and M1(4) is designed to be stored to L1 following M1(1).

The line memories from L1 to L6 are the line memories which can storeone row of inputted image data for each viewpoint, as described above.The regions of those line memories are expressed with the number ofsub-pixels which configure the display part. A single piece of inputtedpixel data carries information of RGB, so that it is formed to be forthree sub-pixels. Thus, in the case of FIG. 52 using the input imagedata which is configured with six-column pixel data on one row, the datasaving regions of six line memories in a sub-pixel unit are for onehundred and eight sub-pixels (6×3×6=108). Further, regarding the case ofFIG. 52, a corresponding relation between three rows of input image dataM1 shown in FIG. 52 and the display panel is shown in FIG. 60. As shownin FIG. 60, 3 rows×6 columns of M1 correspond to the sub-pixels on thenine rows of the even-numbered columns, and 3 rows×6 columns of M2 (notshown) correspond to the sub-pixels of the odd-numbered columns.Therefore, the data saving regions for six line memories mentioned abovecan be expressed as the number of sub-pixels on the 9 rows×12 columns ofthe display part (9×12=108). Further, the regions of the line memoriesrequired for the display panel which has the display part where thesub-pixels are arranged in m-rows and n-columns can be expressed as theregions for 9 rows×n-columns of the sub-pixels.

While the actions of the fifth exemplary embodiment has been describedby referring to the case of the display panel in the layout pattern 1 ofFIG. 8 including the image separating device shown in FIG. 7, theexemplary embodiment is not limited only to that. As in the case of thefirst exemplary embodiment, the fifth exemplary embodiment can beapplied to various layout patterns by setting the parameters inaccordance with the timings shown in FIG. 52.

Further, while the so-called side-by-side form with which the image datafor a plurality of viewpoints are transferred by each row is used as thetransfer form of the input image data in the case of FIG. 52, theso-called dot-by-dot form with which the image data for a plurality ofviewpoints are transferred by each pixel may also be used. As shown inFIG. 53, with the dot-by-dot form, the input image data M1 and M2 shownin FIG. 57 are transferred alternately in a pixel data unit as in “M1(1, 1) RGB”, “M2 (1, 1) RGB”, “M1 (1, 2) RGB”, “M2 (1, 2) RGB”, - - - .Data transfer of a row unit with the dot-by-dot form is expressed withM1 (row number) M2 (row number) as in M1(1) M2(2) shown in FIG. 53, andFIG. 54 shows a timing chart for describing the actions. As in the caseof FIG. 52, FIG. 54 is a chart showing timings when outputting the inputimage data shown in FIG. 57 to the display part in the layout pattern 1shown in FIG. 8 where the image separating device shown in FIG. 7 isdisposed. As shown in FIG. 54, when the dot-by-dot form is used, actionsother than the storage timings of M2 to the line memories shown in FIG.52 are the same as the case of using the side-by-side form (FIG. 52).Thus, the synthesized image data can be generated by using the linememories from L1 to L6. Even in a case where the transfer form of inputimages is the so-called line-by-line form with which the viewpoint imagedata for a plurality of viewpoints are transferred by each column, theexemplary embodiment can also be applied in the same manner as it isevident from the explanations of the actions shown in FIG. 53 and FIG.54.

Further, the fifth exemplary embodiment can be applied to theN-viewpoint panel as described in the second exemplary embodiment. Inthe N-viewpoint panel, 3×N pieces of line memories for one row of eachviewpoint image are prepared and applied under a condition where theperiods obtained by adding N-numbers of data input periods for one rowof each viewpoint image matches with the driving period of threescanning lines of the display panel. Note here that “N” needs to be aneven number.

(Effects)

For the image memory, the fifth exemplary embodiment uses not the framememory but the line memories which store the data of sub-pixels on ninerows of the display part. That is, the image memory provided to thedisplay panel having the display part in which the sub-pixels arearranged in m-rows and n-columns may only need to have the storageregions for at least 9 rows×n-columns of sub-pixels. Therefore, comparedto the display controller having a frame memory, the circuit scale canbe reduced greatly, thereby resulting in cutting the cost. Further, thesize can also be reduced. For example, the number of alternativesregarding the places to have the display controller loaded can beincreased, e.g., the display controller can be built-in to the data-linedriving circuit.

(Sixth Exemplary Embodiment)

The structure of a display device according to a sixth exemplaryembodiment of the present invention will be described. In the displaydevice according to the sixth exemplary embodiment, the region of theline memories provided to the display controller as the image memory inthe fifth exemplary embodiment is reduced further.

FIG. 55 shows a functional block diagram of the sixth exemplaryembodiment. As in the case of the fifth exemplary embodiment, it isconfigured with: a display controller 106 which generates synthesizedimage data CM from image data for each viewpoint inputted from outside;and a display panel 20 which is a display device of the synthesizedimage data. The structure of the display panel 20 is the same as that ofthe first exemplary embodiment, so that explanations thereof are omittedby applying the same reference numerals. The display controller 106includes: as the image memory, a line memory 126 in a smaller numberthan the case of the fifth exemplary embodiment; a writing controldevice 116 which has a function of writing input image data to the linememory 126; a readout control device 136 which has a function of readingout the data from the line memory 126; and a timing control device 156which generates each control signal by using an input synchronoussignal. Other structural elements of the display controller 106 are thesame as those of the fifth exemplary embodiment, so that explanationsthereof are omitted by applying the same reference numerals.

As in the case of the fifth exemplary embodiment, the sixth exemplaryembodiment uses the line memories for the image memory and uses, as thetransform form of the input image data, the so-called side-by-side formwith which the image data for a plurality of viewpoints are transferredby each row.

The display part of the sixth exemplary embodiment is the same structureas that of the first exemplary embodiment, as in the case of the fifthexemplary embodiment. For example, it is formed with the layout pattern1 of FIG. 8 where the image separating device shown in FIG. 7 isdisposed. Therefore, as described in the first exemplary embodiment,regarding the relation between the rows of the input image and thescanning lines, there is a periodicity in a unit of six scanning linesand there exists the regularity shown in FIG. 25. Thus, for transfer ofthe input image data with the side-by-side form, the line memoriesprovided as the image memory only need to have the regions for savingthe data supplied to the sub-pixels of six scanning lines as theminimum.

When the data saving regions required for connecting the six up-and-downsub-pixel pairs to a single scanning line is calculated specifically byusing the case of FIG. 8, it can be expressed with the number ofsub-pixels configuring the display part 50 as “6×6×2=72”.

An example of the actions of the sixth exemplary embodiment using theline memories having such data saving regions will be described byreferring to a timing chart shown in FIG. 56.

FIG. 56 is a chart showing timings when outputting the input image data(generating the synthesized image data) shown in FIG. 57 to the displaypart of the layout pattern 1 shown in FIG. 8 where the image separatingdevice shown in FIG. 7 is disposed, as in the case of the fifthexemplary embodiment. “T” shows one horizontal period of the displaypanel, input data M1 and M2 are pixel data of 4 rows×6 columns shown inFIG. 57. From L1 to L4 are line memories which can store each inputtedviewpoint image data for one row. Since the inputted pixel data carriesinformation RGB, it corresponds to three sub-pixels. Thus, the datasaving regions of four line memories for storing one-row of input imagedata can be expressed as “4×3×6=72” in a sub-pixel unit, which matcheswith the saving regions mentioned above.

Compared to the case of the fifth exemplary embodiment, the actions ofthe sixth exemplary embodiment are different in respect that the sixthexemplary embodiment does not have each line memory corresponded to eachviewpoint image, and stores the input image regardless of its viewpointto the line memory from which data has been already read out. Further,in accordance with this, designation of the line memory to be read outbecomes different. Hereinafter, the actions of the sixth exemplaryembodiment will be described by referring to FIG. 56.

Actions of the period from T1 to T6 shown in FIG. 56 are the same as thecase of the fifth exemplary embodiment. After readout processing of T6is completed, the data of M1(1) stored in L1 becomes unnecessary. Thus,in a next period T7, data of M1(3) is stored to L1. In T7,simultaneously with the storing action of the data of M1(3) to L1, M2(1)B to be supplied to the scanning line G4 is read out from L2 and M2(2) Ris read out from L4, processing is executed thereon, and the data areoutputted to the display panel. In T8, M1(2) R, G is read out from L3 asthe data to be supplied to the scanning line G5, processing is executedthereon, and it is outputted to the display panel. Further, sincereadout action of M2(1) stored in L2 is completed in T7 and the data ofM2(1) stored in L2 is unnecessary, storing action of the input imagedata M2(3) to L2 is started in the middle of T8. In T9, as in the caseof the fifth exemplary embodiment, M2(2) G, B to be supplied to thescanning line G6 is read out from L4, processing is executed thereon,and it is outputted to the display panel. After the readout processingin T9 is completed, the data of M2(2) stored in L4 becomes unnecessary.Thus, in T10, the data of M1(4) is stored to L4. Further, in T10, M1(2)B to be supplied to the scanning line G7 is read out from L3 and M1(3) Ris read out from L1, processing is executed thereon, and the data areoutputted to the display panel. In T11, M2(3) R, G to be supplied to thescanning line G8 is read out from L2, processing is executed thereon,and it is outputted to the display panel. Further, since readout actionof M1(2) stored in L3 is completed in T10 and the data of M1(2) storedin L3 is unnecessary, storing action of the input image data M2(4) to L3is started in the middle of T11. As shown in FIG. 56, the sameprocessing is repeated for each scanning line, and output to the displaypanel is repeated in the manner described above. The input data of thiscase are M1 and M2 configured with pixel data of 4 rows×6 columns shownin FIG. 57, so that there is no input data after T13 of FIG. 56.However, as an example of the actions of a case where there area largernumber of rows than the case of this exemplary embodiment, data storingand readout actions are shown with broken lines.

As described above, in the sixth exemplary embodiment, input dataregardless of its viewpoint is stored to the line memory from which datahas already been read out. As a specific example, as the data stored inL3 and L4, M1 and M2 are stored alternately. With this, compared to thecase of the fifth exemplary embodiment, designation of the line memoryfor storing the input data and designation of the line memory forreading out data become slightly complicated. However, it is possiblewith the sixth exemplary embodiment to operate with still smaller numberof line memories.

While the actions of the sixth exemplary embodiment has been describedby referring to the case of the display panel in the layout pattern ofFIG. 8 including the image separating device shown in FIG. 7, theexemplary embodiment is not limited only to that. As in the case of thefirst exemplary embodiment, the sixth exemplary embodiment can beapplied to various layout patterns by setting the parameters inaccordance with the timings shown in FIG. 56. The regions of the linememories required for the display panel which has the display part wherethe sub-pixels are arranged in m-rows and n-columns are the regions for6 rows×n-columns of the sub-pixels. Further, as in the case of the fifthexemplary embodiment, for the panel of N-viewpoints as the one shown inthe second exemplary embodiment, 2×N pieces of line memories for one rowof each viewpoint image are prepared and applied under a condition wherethe data input period for one row of each viewpoint image matches withthe driving period of three scanning lines of the display panel. Notehere that “N” needs to be an even number.

(Effects)

For the image memory, the sixth exemplary embodiment uses not the framememory but the line memories which store the data of sub-pixels for sixscanning lines. That is, the image memory provided to the display panelhaving the display part in which the sub-pixels are arranged in m-rowsand n-columns may need to have the storage regions for at least 6rows×n-columns of sub-pixels. Therefore, in addition to the effects ofthe fifth exemplary embodiment, the circuit scale of the line memoriescan be reduced further, thereby making it possible to cut the cost andreduce the size.

(Seventh Exemplary Embodiment)

The structure of a display device according to a seventh exemplaryembodiment of the present invention will be described. The displaydevice according to the seventh exemplary embodiment is the same asthose of the fifth and sixth exemplary embodiments in respect that ituses not a frame memory but a plurality of line memories for the imagememory. However, the transfer method of the input image data and thedriving method of the display panel are different. With the seventhexemplary embodiment, the required line memory regions can be reducedfurther compared to the case of the sixth exemplary embodiment.

FIG. 58 shows a functional block diagram of the seventh exemplaryembodiment. As in the case of the first exemplary embodiment, it isconfigured with: a display controller 107 which generates synthesizedimage data CM from image data for each viewpoint inputted from outside;and a display panel 21 which is a display device of the synthesizedimage data. For the structure of the display panel 21, the display part50 and the data-line driving circuit 80 are the same as those of thefirst exemplary embodiment while the scanning-line driving circuit isdifferent. The scanning-line driving circuit configuring the seventhexemplary embodiment includes scanning circuits which are capable ofperforming scanning on even-numbered columns and on odd-numbered columnsof the display part which is configured with sub-pixels ofm-rows×n-columns. As an example of the scanning-line driving circuit ofthe seventh exemplary embodiment, a scanning-line driving circuit A(60A) which sequentially drives the odd-numbered scanning lines G1, G3,G5, - - - and a scanning-line driving circuit B (60B) which sequentiallydrives the eve-numbered scanning lines G2, G4, G6, - - - are shown inFIG. 58. The display controller 107 includes: a line memory 127; acontrol device 117 which has a function of writing input image data tothe line memory 127; and a readout control device 137 which has afunction of reading out the data from the line memory 127. Further, thedisplay controller 107 includes: a timing control device 157 whichgenerates a vertical control signal 62 and a horizontal driving signal82 for driving the display panel 21 by synchronizing with the inputsynchronous signal, and outputs those control signals to the readoutcontrol device 137, the scanning-line driving circuits 60A, 60B, and thedata-line driving circuit 80; and a parameter storage device 140 whichhas a function of storing parameters required for rearranging the datain accordance with the layout of the display part 50 as in the case ofthe first exemplary embodiment.

As described, the seventh exemplary embodiment does not use a framememory as the image memory as in the case of the fifth exemplaryembodiment. Thus, there is a restriction in the transfer form of theinput image data, and the timing between the input data and the outputdata. As an example of the actions of the seventh exemplary embodiment,FIG. 59 shows a timing chart when driving the display panel in thelayout pattern 1 of FIG. 8 which includes the image separating deviceshown in FIG. 7.

“T” shown in FIG. 59 shows one horizontal period of the display panel,and input data M1 and M2 are pixel data of 4 rows×6 columns shown inFIG. 57. Input data M1(1) and M2(1) shown in FIG. 59 indicate the firstrow of the first viewpoint image data M1 and the second row of thesecond viewpoint image data. The transfer form of the first viewpointimage shown in the seventh exemplary embodiment is the so-called framesequential method with which the input data for one viewpoint istransferred and the other input image data is transferred thereafter, asshown in FIG. 59. The seventh exemplary embodiment does not use a framememory, so that outputs to the display panel are executed for eachsub-pixel corresponding to the viewpoint of the input image data. Asdescribed in the first exemplary embodiment, the viewpoint images towhich the sub-pixels of the display part correspond are determineddepending on the layout of the image separating device as in the casesof FIG. 7 and FIG. 24, and the sub-pixels corresponding to eachviewpoint can be selected with even/odd of the scanning lines to beconnected as in the cases of FIG. 8 and FIG. 18. Thus, with the seventhexemplary embodiment, the scanning lines are classified into odd andeven numbered lines, and odd-numbered lines and even-numbered lines arescanned sequentially. Outputs G1, G3, - - - , G13 shown in FIG. 59 showthe data outputs to the sub-pixels connected to the odd-numberedscanning lines of the display part shown in FIG. 8, and outputs G2,G4, - - - , G12 show the data outputs to the sub-pixels connected to theeven-numbered scanning lines of the display part shown in FIG. 8.Further, in order to minimize the storage regions of the line memoriesused instead of the frame memory, the input period for two rows of inputimage data for each viewpoint and three horizontal periods of thedisplay panel output are set to be the same.

From L1 to L3 shown in FIG. 59 are line memories used as the imagememory in the seventh exemplary embodiment, which can store eachinputted viewpoint image data for one row. Since the inputted pixel datacarries information RGB, one row of each inputted viewpoint pixel datacorresponds to sub-pixels of 3 rows×n/2-columns. FIG. 60 shows acorresponding relation regarding input data M1(1), input data M1(2),input data M1(3), and the sub-pixels of the display part shown in FIG.8. As can be seen from FIG. 60, the data saving regions of four linememories for storing one-row of input image data can be expressed as“3×3×6=54” in a sub-pixel unit.

Details of the actions of the seventh exemplary embodiment will bedescribed by referring to FIG. 59. In the period of T1-T3, the inputdata M1(1) is stored to L1 and the input data M2(1) is stored to L2.Further, in the period of T3, in parallel to the storing action of M1(1)to L2, the data for the scanning line G1 is read out from L1 where M1(1)is stored, and the same data as the synthesized image data described inthe first exemplary embodiment is outputted by executing the rearrangingprocessing based on the information of the display panel and theregularity described in the first exemplary embodiment. Specifically,data of R is read out from M1(1) to G1, rearranging processing isexecuted thereon, and it is outputted to the display panel. Then, in T4,storing action of M1(3) to L3 is started and, at the same time, dataM1(1) G, R to be supplied to the scanning line G3 is read out from L1,the rearranging processing is executed thereon, and it is outputted tothe display panel. In T5, data M1(2) G, R to be supplied to the scanningline G5 is read out from L2, the rearranging processing is executedthereon, and it is outputted to the display panel. Further, when T4ends, all the data M1(1) stored in L1 are readout and becomeunnecessary. Thus, storing action of M1(4) to L1 is started in themiddle of T5. In T6, in parallel to storing action of M1(4) to L1, dataM1(2) B to be supplied to the scanning line G7 is read out from L2 andM1(3) R is read out from L3, the rearranging processing is executedthereon, and the data are outputted to the display panel. In T7, dataM1(3) G, B to be supplied to the scanning line G9 is read out from L3,the rearranging processing is executed thereon, and the data areoutputted to the display panel. Data input of M1 is completed in T6, sothat the period of T7 regarding input data is a blanking period. In T8,data M1(4) R, G to be supplied to the scanning line G11 is read out fromL1, the rearranging processing is executed thereon, and it is outputtedto the display panel. Further, storing action of input data M2(1) to L2is started in the middle of T8. In T9, in parallel to the storing actionof M2(1) to L2, data M1(4) B to be supplied to the scanning line G13 isread out from L1, the rearranging processing is executed thereon, and itis outputted to the display panel. Storing action of input data M2(2) toL3 is started in T10. The data output to the odd-numbered scanning linesis completed in T9, so that the period of T10 regarding output is ablanking period. In T11, data M2(1) R, G to be supplied to the scanningline G2 is read out from L2, the rearranging processing is executedthereon, and it is outputted to the display panel. Storing action ofinput data M2(3) to L1 is started in the middle of T11. In T12, inparallel to the storing action of M2(3) to L1, M2(1) B to be supplied tothe scanning line G4 is read out from L2 and M2(2) R is read out fromL3, the rearranging processing is executed thereon, and the data areoutputted to the display panel. When the readout processing in T12 isended, the data of M2(1) stored in L2 becomes unnecessary. Thus, in anext period T13, M2(4) is stored to L2. In T13, in parallel to storingaction of M2(4) to L2, M2(2) G, B to be supplied to the scanning line 6is read out from L3, the rearranging processing is executed thereon, andit is outputted to the display panel. In T14, in parallel to the storingaction of M2(4), data M2(3) R, G to be supplied to the scanning line G8is read out from L1, the rearranging processing is executed thereon, andit is outputted to the display panel. The storing action of M2(4) to L2is ended in the middle of T14, so that the periods thereafter regardinginput data become blanking periods. In T15, M2(3) B to be supplied tothe scanning line G10 is read out from L1 and M2(4) R is read out fromL2, the rearranging processing is executed thereon, and the data areoutputted to the display panel. In T16, M2(4) G, B to be supplied to thescanning line G12 is read out from L2, the rearranging processing isexecuted thereon, and it is outputted to the display panel.

While the actions of the seventh exemplary embodiment has been describedby referring to the case of the display panel in the layout pattern 1 ofFIG. 8 including the image separating device shown in FIG. 7, theexemplary embodiment is not limited only to that. As in the case of thefirst exemplary embodiment, the seventh exemplary embodiment can beapplied to various layout patterns by using the regularity of thesub-pixel layout described in the first exemplary embodiment and byparameter setting. Further, while the scanning circuits used in theseventh exemplary embodiment are expressed as the scanning-line drivingcircuit A which scans the odd-numbered scanning lines and thescanning-line circuit B which scans the even-numbered scanning lines, itis also possible to achieve the driving actions shown in FIG. 59 byconnecting the outputs of a single scanning-line driving circuit firstto the odd-numbered scanning lines and then to the even-numberedscanning lines sequentially. Further, it is also possible to employ astructure which uses a single scanning-line drive IC which can scan theodd-numbered outputs and the even-numbered outputs, respectively.

(Effects)

With the seventh exemplary embodiment, the image memory provided to thedisplay panel having the display part in which the sub-pixels arearranged in m-rows and n-columns may only need to have the storageregions for at least 9 rows×(n/2) columns of sub-pixels. Therefore,compared to the display controller having a frame memory, the circuitscale can be reduced greatly, thereby resulting in cutting the cost.Further, the size can also be reduced. For example, the number ofalternatives regarding the places to have the display controller loadedcan be increased, e.g., the display controller can be built-in to thedata-line driving circuit.

(Eighth Exemplary Embodiment)

The structure of a display device according to an eighth exemplaryembodiment of the present invention will be described. The displaydevice according to the eighth exemplary embodiment is the same as thatof the seventh exemplary embodiment in respect that it uses not a framememory but a plurality of line memories for the image memory and thatthe transfer form of input image data is the so-called frame sequentialmethod. However, the driving method of the display panel is different.The eighth exemplary embodiment includes a scanning circuit which canscan all the scanning lines of the display panel twice in a transferperiod of two inputted viewpoint images for the left and right, so thatit is unnecessary to use the scanning-line driving circuit which scansthe scanning lines separately for the odd-numbered lines and theeven-numbered lines as in the case of the seventh exemplary embodiment.

FIG. 61 shows a functional block diagram of the eighth exemplaryembodiment. As in the case of the sixth exemplary embodiment, it isconfigured with: a display controller 108 which generates synthesizedimage data CM from image data for each viewpoint inputted from outside;and a display panel 22 which is a display device of the synthesizedimage data. For the structure of the display panel 22, the display part50 and the data-line driving circuit 80 are the same as those of theseventh exemplary embodiment but the scanning-line driving circuit isdifferent. The scanning-line driving circuit 67 configuring the eighthexemplary embodiment includes a function which can perform scanningtwice on all the scanning lines of the display part within a transferperiod of two viewpoint images for the left and right inputted by theframe sequential method. The display controller 108 includes a linememory 127 and a control device 117 which has a function of writinginput image data to the line memory 127, as in the case of the seventhexemplary embodiment. Further, the eighth exemplary embodiment includesa readout control device 138 which has: a function of reading out andrearranging the data from the line memory 127 at a double speed comparedto the case of the seventh exemplary embodiment under a condition thatthe transfer rate of input data is the same; and a function whichsupplies data with which a viewpoint display image with no input databecomes black. Further, the display controller 108 includes: a timingcontrol device 158 which generates a vertical control signal 63 and ahorizontal driving signal 83 for driving the display panel 22 bysynchronizing with the input synchronous signal and outputs thosecontrol signals to the readout control device 138, the scanning-linedriving circuit 67, and the data-line driving circuit 80; and aparameter storage device 140 which has a function of storing parametersrequired for rearranging the data in accordance with the layout of thedisplay part 50 as in the case of the first exemplary embodiment.

The eighth exemplary embodiment does not use a frame memory as the imagememory as in the case of the fifth-seventh exemplary embodiments. Thus,there is a restriction in the transfer form of the input image data, andthe timing between the input data and the output data. As an example ofthe actions of the eighth exemplary embodiment, FIG. 62 shows a timingchart when driving the display panel in the layout pattern 1 of FIG. 8which includes the image separating device shown in FIG. 7.

As in the cases of the fifth-seventh exemplary embodiments, “T” shown inFIG. 62 shows one horizontal period of the display panel, and input dataM1 and M2 are pixel data of 4 rows×6 columns shown in FIG. 57. Further,input data M1(1) and M2(1) shown in FIG. 62 indicate the first row ofthe first viewpoint image data M1 and the second row of the secondviewpoint image data. As in the cases of the fifth-seventh exemplaryembodiments, the transfer form of the first viewpoint image shown of theeighth exemplary embodiment is the so-called frame sequential methodwith which the input data for one viewpoint is transferred and the otherinput image data is transferred thereafter, as shown in FIG. 62. OutputsG1, G2, G3, - - - , G12, G13 shown in FIG. 62 show the data outputs tothe sub-pixels connected to the odd-numbered scanning lines of thedisplay part shown in FIG. 8. In the eighth exemplary embodiment, asshown in FIG. 62, all the scanning lines of the display part are scannedby corresponding to the transfer period of the input data M1, and allthe scanning lines of the display part are scanned by corresponding tothe transfer period of the input data M2. That is, all the scanninglines of the display part are scanned twice within the transfer periodof the two viewpoint images for the left and right. In the eighthexemplary embodiment, regarding the data outputted in accordance withthe scanning, as in the case of the seventh exemplary embodiment, thedata read out from the line memory and on which rearranging processingis executed is supplied to the pixel which displays the viewpoint imageto which the input data corresponds, and data for displaying black issupplied to the pixel which displays the viewpoint image to which theinput data does not correspond. In the case of FIG. 62, the firstviewpoint image data M1 is inputted in a period of T1-T2, and stored tothe line memory. FIG. 62 is a driving example of the display panel shownin FIG. 7 and FIG. 8, so that the odd-numbered scanning lines (G1,G3, - - - , G13) are connected to the pixels for displaying M1.Therefore, regarding the output to the display panel in T5-T17, as inthe case of the fifth exemplary embodiment, the data read out from theline memories and to which the rearranging processing is executed issupplied to the outputs to which the odd-numbered scanning lines (G1.G3, - - - , G13) correspond, and the data for providing black display issupplied to the output corresponding the even-numbered scanning lines(G2, G4, - - - , G12). Further, in the case of FIG. 62, the secondviewpoint image data M2 is inputted in a period of T16-T17, and storedto the line memory. As described earlier, in this case, theeven-numbered scanning lines (G2, G4, - - - , G12) are connected to thepixels for displaying M2. Therefore, regarding the output to the displaypanel in T21-T33, the data for providing black display is supplied tothe outputs to which the odd-numbered scanning lines (G1, G3, - - - ,G13) correspond, and the data read out from the line memories and towhich the rearranging processing is executed is supplied to the outputcorresponding the even-numbered scanning lines (G2, G4, - - - , G12), asin the case of the fifth exemplary embodiment.

As shown in FIG. 62, in order to minimize the storage regions of theline memories used instead of the frame memory, the input period for onerow of input image data for each viewpoint and three horizontal periodsof the display panel output are set to be the same. The line memoriesfrom L1 to L3 store one row of each viewpoint pixel data inputtedrespectively, as in the case of the seventh exemplary embodiment.Further, the saving regions required for the line memories from L1 to L3can be expressed as “3×3×6=54” in a sub-pixel unit as in the case of theseventh exemplary embodiment.

(Effects)

With the eighth exemplary embodiment, as in the case of the seventhexemplary embodiment, the image memory provided to the display panelhaving the display part in which the sub-pixels are arranged in m-rowsand n-columns may only need to have the storage regions for at least 9rows×(n/2) columns of sub-pixels. Therefore, the same effects as thoseof the sixth exemplary embodiment can be achieved. Further, since it isunnecessary to scan the odd-numbered and even-numbered scanning linesseparately, the structure of the display panel can become simpler andeasier to be designed compared to the case of the seventh exemplaryembodiment.

The present invention can also be structured as follows.

The present invention is a display controller for outputting synthesizedimage data to a display module which includes: a display part in whichsub-pixels connected to data lines via switching devices controlled byscanning lines are arranged in m-rows and n-columns, which is driven by(m+1) pieces of the scanning lines and at least n piece of the dataline; and a first image separating device which directs light emittedfrom the sub-pixels towards at least two spaces viewpoints in asub-pixel unit. The display controller includes: an image memory whichstores at least two pieces of viewpoint image data; a writing controldevice which writes at least the two pieces of viewpoint image datainputted from outside to the image memory; a parameter storage devicewhich stores a positional relation between the first image separatingdevice and the display part; and a readout control device which readsout the viewpoint image data from the image memory according to areadout order that is obtained by applying the parameters to a repeatingregulation that is determined based on layout of the sub-pixels, numberof colors, and layout of the colors, and outputs the readout data to thedisplay module as the synthesized image data.

Further, the present invention is an image processing method forgenerating synthesized image data to be outputted to a display modulewhich includes: a display part having sub-pixels connected to data linesvia switching devices controlled by scanning lines are arranged inm-rows in the vertical direction and in n-columns in the horizontaldirection, which is driven by (m+1) pieces of scanning lines and (n+1)pieces of data lines; and an image separating device which directs lightemitted from a plurality of sub-pixels of the display towards at leasttwo spaces in a unit of the sub-pixel. The image processing methodincludes: a parameter reading step which reads parameters showing apositional relation between the image separating device and the displaypart of the display module; a writing step which writes at least twoviewpoint images inputted from outside into the image memory; and areadout step which reads out the viewpoint image from the image memoryand outputs the read out data as the synthesized image data to thedisplay module in accordance with an readout order obtained by applyingthe parameters to a prescribed repeating rule that is determineddepending on layout and number of colors of the sub-pixels.

The present invention makes it possible to arrange the wirings and TFTsefficiently for each pixel having substantially a trapezoid aperture ofthe display device to which the image distributing optical device suchas a lenticular lens or a parallax barrier is provided. Thus, it ispossible to achieve high numerical aperture and high image quality. Inachieving the high image quality, the connecting pattern regarding thescanning lines as well as the data lines with respect to the rows andcolumns of the sub-pixels becomes different from the case of a typicalpanel. However, because the regularity has been found, the scanninglines and the data lines connected to the sub-pixels arranged inarbitrary number of rows and columns can be found without actualdesigning. Further, it is possible to generate synthesized image datafrom the found regularity, layout of the image separating device,coloring orders of the color filter, and the layout pattern of theup-and-down sub-pixel pair as the minimum unit. Through providing thevideo signal processing device which generates the synthesized imagedata, the device for creating the synthesized image data and the methodfor creating the synthesized image data can be provided. This makes itpossible to use the input image data of a same transfer form as that ofa typical flat display device, so that there is no load) rearrangementof the output image data, for example) imposed upon the devices to whichthe display device is employed. Furthermore, since the conditions forgenerating the synthesized image data are put into parameters and thedevice for storing the parameters is provided, it only needs to changethe parameters when there is a change in the display module and does notneed to change the video signal processing device. Therefore, the numberof designing steps and the cost thereof can be reduced.

Next, ninth to thirteenth exemplary embodiments of the present inventionwill be described. It is noted that the structures of the up-and-downsub-pixel pairs, the layout pattern, LUT, and the synthesized image dataof the ninth to thirteenth exemplary embodiments are different fromthose of the up-and-down sub-pixel pairs, the layout pattern, LUT, andthe synthesized image data of the first to eighth exemplary embodiments;however, the same reference numerals are applied for convenience's sake.

The display module of the display device which uses the displaycontroller of the present invention is the display module which includesan image separating device which directs light emitted from sub-pixelstowards a plurality of viewpoints in an extending direction of the datalines. The display module achieves the high numerical aperture and highimage quality by the characteristic connecting relation regarding thescanning lines as well as the data lines with respect to the switchingdevise of each sub-pixel. The inventors of the present invention havefound the regularity in the characteristic connecting relation regardingthe sub-pixels and the scanning lines as well as the data lines of thedisplay module. Further, the inventors of the present invention haveinvented the display controller which creates the synthesized image datafrom the found regularity, the placement condition of the imageseparating device, coloring order of the sub-pixels, and the layoutpattern of the up-and-down sub-pixel pairs.

Hereinafter, the exemplary embodiments of the present invention will bedescribed. In the explanations of the ninth exemplary embodiment to thethirteenth exemplary embodiment hereinafter, the array of the pixelelectrodes along the horizontal direction of the display panel is called“row” and the array of the pixel electrodes along the vertical directionis called “column”. Further, in the display panel of the presentinvention, the scanning lines are arranged along the horizontaldirection, the data lines are arranged along the vertical direction, andthe image distributing direction by the image separating device is thehorizontal direction.

(Ninth Exemplary Embodiment)

First, the outline of a ninth exemplary embodiment will be described. Adisplay module (400) includes a display part (250) and an imageseparating device (230). In the display part (250), sub-pixels (240)connected to data lines (D1, - - - ) via switching devices (246)controlled by scanning lines (G1, - - - ) are arranged in m-rows andn-columns (m and n are natural numbers), and the sub-pixels (240) aredriven by m+1 pieces of scanning lines (G1, - - - ) and at least n+1pieces of data lines (D1, - - - ). The image separating device (230)directs the light emitted from the sub-pixels (240) to a plurality ofviewpoints in the extending direction of the data lines (D1, - - - ) bya unit of the sub-pixel (240).

Further, the display controller (300) includes an image memory (320), awriting control device (310), and a readout control device (330), andoutputs synthesized image data (CM) to the display module (400). Theimage memory (320) stores viewpoint image data for a plurality ofviewpoints. The writing control device (310) writes viewpoint image datainputted from outside into the image memory (320). The readout controldevice (330) reads out the viewpoint image data from the image memory(320) in accordance with the readout order corresponding to the displaymodule (400), and outputs it to the display module (400) as thesynthesized image data (CM).

The readout order corresponding to the display module (400) may be thereadout order that is obtained based on the positional relation betweenthe image separating device (230) and the display part (250), the layoutof the sub-pixels (240), the number of colors, and the layout of thecolors.

The display controller (300) may further include a parameter storagedevice (340) which stores parameters showing the positional relationbetween the image separating device (230) and the display part (250),the layout of the sub-pixels (240), the number of colors, and the layoutof the colors.

The display part (250) may be formed by having an up-and-down sub-pixelpair (P2R, P2L) configured with two sub-pixels (240) arranged bysandwiching a single data line (D1, - - - ) as a basic unit. In thiscase, the switching devices (246) provided to each of the two sub-pixels(240) is connected in common to the data line (D1, - - - ) sandwiched bythe two sub-pixels (240), and controlled in common by different scanninglines (G1, - - - ). The up-and-down sub-pixel pairs (P2R, P2L)neighboring to each other in the extending direction of the data lines(D1, - - - ) are so arranged to be connected to different data lines(D1, - - - ).

As for the number of colors of the sub-pixels (240), there are threecolors such as a first color, a second color, and a third color. Thefirst color, the second color, and the third color are one of the colorsR (red), G (green), and B (blue), for example, and are different fromeach other. In this case, the display part (250) may be formed asfollows. Provided that “y” is a natural number, regarding the twosub-pixels (240) of the up-and-down sub-pixel pair (P2R, P2L) connectedto the y-th data line (Dy), the color of one of the two sub-pixels isthe first color while the other is the second color, and forms either aneven column or an odd column of the display part (250). Regarding thetwo sub-pixels (240) of the up-and-down sub-pixel pair (P2R, P2L)connected to the (y+1)-th data line (Dy+1), the color of one of the twosub-pixels is the second color while the other is the third color, andforms the other one of the even column or the odd column of the displaypart (250). Regarding the two sub-pixels (240) of the up-and-downsub-pixel pair (P2R, P2L) connected to the (y+2)-th data line (Dy+2),the color of one of the two sub-pixels is the third color while theother is the first color, and forms one of the even column or the oddcolumn of the display part (250). Regarding the two sub-pixels (240) ofthe up-and-down sub-pixel pair (P2R, P2L) connected to the (y+3)-th dataline (Dy+3), the color of one of the two sub-pixels is the first colorwhile the other is the second color, and forms the other one of the evencolumn or the odd column of the display part (250). Regarding the twosub-pixels (240) of the up-and-down sub-pixel pair (P2R, P2L) connectedto the (y+4)-th data line (Dy+4), the color of one of the two sub-pixelsis the second color while the other is the third color, and forms one ofthe even column or the odd column of the display part (250). Regardingthe two sub-pixels (240) of the up-and-down sub-pixel pair (P2R, P2L)connected to the (y+5)-th data line (Dy+5), the color of one of the twosub-pixels is the third color while the other is the first color, andforms the other one of the even column or the odd column of the displaypart (250).

At this time, the readout control device (330) may read out theviewpoint image data from the image memory (320) according to thereadout order as follows. That is, the colors read out by correspondingto the y-th data line (Dy) are the first color and the second color, andthe readout viewpoint image is the image which corresponds to either aneven column or an odd column of the display part (250). The colors readout by corresponding to the (y+1)-th data line (Dy+1) are the secondcolor and the third color, and the viewpoint image is the image whichcorresponds to the other one of the even column or the odd column of thedisplay part (250). The colors read out by corresponding to the (y+2)-thdata line (Dy+2) are the third color and the first color, the viewpointimage is the image which corresponds to either the even column or theodd column of the display part (250). The colors read out bycorresponding to the (y+3)-th data line (Dy+3) are the first color andthe second color, and the viewpoint image is the image which correspondsto the other one of the even column or the odd column of the displaypart (250). The colors read out by corresponding to the (y+4)-th dataline (Dy+4) are the second color and the third color, and the viewpointimage is the image which corresponds to either the even column or theodd column of the display part (250). The colors read out bycorresponding to the (y+5)-th data line (Dy+5) are the third color andthe first color, and the viewpoint image is the image which correspondsto the other one of the even column or the odd column of the displaypart (250).

An image processing method according to the exemplary embodiment isachieved by actions of the display controller (300) of the exemplaryembodiment. That is, the image processing method of the exemplaryembodiment is a method for generating the synthesized image data CM tobe outputted the display module (400), which includes the followingsteps of 1-3. 1: A step which writes viewpoint image data for aplurality of viewpoints inputted from outside into the image memory(320). 2: A step which reads out the viewpoint image data from the imagememory (320) according to the readout order corresponding to the displaymodule (400). 3: A step which outputs the read out viewpoint image datato the display module (400) as the synthesized image data (CM). Detailsof the image processing method according to the exemplary embodimentconform to the actions of the display controller (300) according to theexemplary embodiment. Image processing methods according to otherexemplary embodiments are achieved by the actions of the displaycontrollers of the other exemplary embodiments as in the case of thefirst exemplary embodiment, so that explanations thereof are omitted.

An image processing program according to the exemplary embodiment is forcausing a computer to execute the actions of the display controller(300) of the exemplary embodiment. When the display controller (300)includes a computer formed with a memory, a CPU, and the like, the imageprocessing program of the exemplary embodiment is stored in the memory,and the CPU reads out, interprets, and executes the image processingprogram of the exemplary embodiment. That is, the image processingprogram of the exemplary embodiment is a program for generating thesynthesized image data (CM) to be outputted to the display module (400),which causes the computer to execute following procedures 1-3. 1: Aprocedure which writes viewpoint image data for a plurality ofviewpoints inputted from outside into the image memory (320). 2: Aprocedure which reads out the viewpoint image data from the image memory(320) according to the readout order corresponding to the display module(400). 3: A procedure which outputs the read out viewpoint image data tothe display module (400) as the synthesized image data (CM). Details ofthe image processing program according to the exemplary embodimentconform to the actions of the display controller (300) according to theexemplary embodiment. Image processing programs according to otherexemplary embodiments are causing the computer to execute the actions ofthe display controllers of the other exemplary embodiments as in thecase of the first exemplary embodiment, so that explanations thereof areomitted.

The use of the exemplary embodiment makes it possible to use input imagedata in the same transfer form as that of a typical flat display devicefor the display module which includes the image separating device thatdirects the light emitted from the sub-pixels to a plurality ofviewpoints in the extending direction of the data lines. Thus, it isunnecessary to execute the image data rearranging processing and anyspecial processing for transfer, so that there is no load imposed uponan arithmetic operation device, for example, which outputs the imagedata to the display device of the present invention which includes thedisplay controller. Furthermore, the condition for generating thesynthesized image data CM is put into parameters, and the parameterstorage device for storing the parameter is provided. Thus, when thereis a change in the display module, it simply needs to change theparameters. This makes it possible to decrease the number of designingsteps and to reduce the cost. Hereinafter, the ninth exemplaryembodiment will be described in more details.

(Explanation of Structures)

Structures of the display device according to the ninth exemplaryembodiment of the present invention will be described.

FIG. 64 is a schematic block diagram of a stereoscopic display device ofthe exemplary embodiment, which shows an optical model viewed above thehead of an observer. The outline of the exemplary embodiment will bedescribed by referring to FIG. 64. The display device according to theexemplary embodiment is formed with the display controller 300 and thedisplay module 400. The display controller 300 has a function whichgenerates synthesized image data CM from a first viewpoint image data(left-eye image data) M1 and a second viewpoint image data (right-eyeimage data) inputted from outside. The display module 400 includes alenticular lens 230 as an optical image separating device of displayedsynthesized image and a backlight 215 provided to the display panel 220which is the display device of the synthesized image data CM.

Referring to FIG. 64, the optical system of the exemplary embodimentwill be described. The display panel 220 is a liquid crystal panel, andit includes the lenticular lens 230 and the backlight 215. The liquidcrystal panel is in a structure in which a glass substrate 225 on whicha plurality of sub-pixels 241 and 242 as the minimum display unit areformed and a counter substrate 227 having color filters (not shown) andcounter electrodes (not shown) are disposed by sandwiching a liquidcrystal layer 226. On the faces of the glass substrate 225 and thecounter substrate 227 on the opposite sides of the liquid crystal layer226, polarization plate (not shown) is provided, respectively. Each ofthe sub-pixels 241 and 242 is provided with a transparent pixelelectrode (not shown). The polarization state of the transmitted lightis controlled by applying voltages to the liquid crystal layer 226between the respective pixel electrodes and the counter electrodes ofthe counter substrate 227. Light rays 216 emitted from the backlight 215pass through the polarization plate of the glass substrate 225, theliquid crystal layer 226, the color filters of the counter substrate227, and the polarization plate, thereby intensity modulation andcoloring can be done.

The lenticular lens 230 is formed with cylindrical lenses 230 aexhibiting the lens effect to one direction arranged on a plurality ofcolumns along the horizontal direction. The lenticular lens 230 isarranged in such a manner that projected images from all the sub-pixels241 overlap with each other and the projected images from all thesub-pixels 242 overlap with each other at an observing plane 217 that isaway from the lens by a distance OD, by alternately using the pluralityof sub-pixels on the glass substrate 225 as the first viewpoint(left-eye) sub-pixel 241 and the second viewpoint (right-eye) sub-pixel242. With the above-described structure, a left-eye image formed withthe sub-pixels 241 is provided to the left eye of the observer at thedistance OD and the right-eye image formed with the sub-pixels 242 isprovided to the right eye.

Next, details of the display controller 300 and the display panel 220shown in FIG. 64 will be described. FIG. 63 is a block diagram of thisexemplary embodiment showing the functional structures from image inputto image display.

The input image data inputted from outside has viewpoint images M1, M2,and each of the viewpoint mages M1, M2 is configured with i-rows andj-columns of pixel data. Each pixel data carries three-color luminanceinformation regarding R(red) luminance, G(green) luminance, and B(blue)luminance. The image data is inputted along with a plurality ofsynchronous signals, the position of each pixel data within the image(i.e., the row number and the column number) is specified based on thesynchronous signals. Hereinafter, a pixel configuring an arbitrary rowand an arbitrary column of input image data is expressed as Mk (row,column) RGB (k shows the viewpoint number (left/right). That is, M1 isan aggregate of the pixel data from M1 (1, 1) RGB, M1 (1, 2) RGB, to M1(i, j) RGB. M2 is an aggregate of the pixel data from M2 (1, 1) RGB, M2(1, 2) RGB, to M2 (i, j) RGB. For example, “R” corresponds to the firstcolor, “G” corresponds to the second color, and “B” corresponds to thethird color.

The display controller 300 includes the writing control device 310, theimage memory 320, the readout control device 330, the parameter storagedevice 340, and the timing control device 350.

The writing control device 310 has a function which generates a writingaddress given to the inputted image data {Mk (row, column) RGB} inaccordance with the synchronous signal inputted along the image data.Further, the writing control device 310 has a function which gives thewriting address to an address bus 295, and writes the input image dataformed with the pixel data to the image memory 320 via a data bus 290.While the synchronous signal inputted from outside is illustrated with asingle thick-line arrow in FIG. 63 for convenience's sake, thesynchronous signals are formed with a plurality of signals such asvertical/horizontal synchronous signal, data clock, data enable, and thelike.

The readout control device 330 includes: a function which generates areadout address according to a prescribed pattern in accordance withparameter information 251 of the display part 250 supplied from theparameter storage device 340, and a control signal 261 of ascanning-line driving circuit 260 as well as a control signal 281 of adata-line driving circuit 280 from the timing control device 350; afunction which gives the readout address to the address bus 295, andreads out pixel data via the data bus 290; and a function which outputsthe read out data to the data-line driving circuit 280 as thesynthesized image data CM.

The parameter storage device 340 includes a function which stores theparameters required for rearranging data in accordance with the layoutof the display part 250 to be described later in more details.

The timing control device 350 includes a function which generates thecontrol signals 261, 281 to be given to the scanning-line drivingcircuit 260 and the data-line driving circuit 280 of the display panel220, and outputs those to the readout control device 330, thescanning-line driving circuit 260, and the data-line driving circuit280. While each of the control signals 261 and 281 is illustrated by asingle thick-line arrow in FIG. 63 for the convenience' sake, thesignals include a plurality of signals such as a start signal, a clocksignal an enable signal, and the like.

The display panel 220 includes: a plurality of scanning lines G1,G2, - - - , Gm, Gm+1 and the scanning-line drive circuit 260; aplurality of data lines D1, D2, - - - , Dn, Dn+1 and the data-linedriving circuit 280; and the display part 250 which is formed with aplurality of sub-pixels 240 arranged in n-rows×m-columns.

FIG. 63 is a schematic illustration of the functional structures, andthe shapes and the connecting relations of the scanning lines G1, - - -, the data lines D1, - - - , and the sub-pixels 240 will be describedlater. Although not shown, the sub-pixel 240 includes a TFT as aswitching device and a pixel electrode. The gate electrode of the TFT isconnected to the scanning line G1, - - - , the source electrode isconnected to the pixel electrode, and the drain electrode is connectedto the data line D1, - - - . The TFT turns ON/OFF according to thevoltages that are supplied to the arbitrary connected scanning lines Gxsequentially from the scanning-line driving circuit 260. When the TFTturns ON, the voltage is written to the pixel electrode from the dataline D1, - - - . The data-line driving circuit 280 and the scanning-linedriving circuit 260 may be formed on the glass substrate where the TFTsare formed or may be loaded on the glass substrate or separately fromthe glass substrate by using driving ICs.

In the display part 250 of the display panel 220 of this exemplaryembodiment, the data lines D1, - - - are disposed by having theextending direction thereof along the horizontal direction and thescanning lines G1, - - - are disposed by having the extending directionthereof along the vertical direction. This layout relation has an effectof reducing the region other than the display part 250 which contributesto image display (the region so-called “frame”), in a case where thedisplay part 250 is a landscape type (for example, when it is in alaterally long shape of 16:9). Further, there are also effects ofincreasing the number of sub-pixels of the display part 250 for enablinghigh resolution and of cutting the cost when the high resolution isachieved. Hereinafter, the reasons thereof will be described byreferring to FIG. 66.

FIG. 66 is an example of the display panel having the landscape(laterally long shape) display part 250, which includes driving ICs 280a, 280 b as the data-line driving circuit 280 (FIG. 63) and scanningcircuits 260 a, 260 b as the scanning-line driving circuit 260 (FIG. 63)formed on the glass substrate (not shown) of the display panel. Thescanning circuits 260 a and 260 b are formed by using TFTs that areformed by the same process as that of the TFTs used for the switchingdevices.

FIG. 66A shows an example where the data lines are arranged in thehorizontal direction (X direction) as in the case of this exemplaryembodiment. FIG. 66B shows an example where the data lines are arrangedin the vertical direction (Y direction). In both cases of FIG. 66A andFIG. 66B, the lenticular lenses 230 as the image separating devices areso disposed that the image separating direction becomes the horizontaldirection (X direction). Further, the sub-pixels (not shown) aredisposed in the regions surrounded by the scanning lines and the datalines. The light emitted from the sub-pixels are colored in R(red),G(green), or B(blue) by the color filters (not shown).

In the display device of the ninth exemplary embodiment, the displayunit of the first viewpoint image (for the left eye) is formed withsub-pixels of R(red), G(green), and B(blue) and, similarly, the displayunit of the second viewpoint image (for the right eye) is formed withsub-pixels of R(red), G(green), and B(blue). Thus, as shown in FIG. 66,a stereoscopic display unit 235 is configured with a total of sixsub-pixels, and the pitches of the stereoscopic display unit in thehorizontal direction (X direction) and in the vertical direction (Ydirection) are the same.

Output pins of the driving ICs 280 a and 280 b are connected to the datalines of the display part 250, respectively. In general, the pitch ofthe output pins of the driving ICs used as the data-line drivingcircuits are narrower than the pitch of the data lines. Thus, thewirings from the output pins of the driving ICs to each data lineexhibits expansions, so that there requires distance LDa, LDb from thedisplay part 250 to the driving ICs 280 a, 280 b for the wirings. Thedistance from the display part to the driving IC can be shortened as thenumber of the data lines to be connected becomes less, provided that thepitch of the output pins of the driving IC is the same. In a case wherethe display part is a landscape (laterally long shape) type, there aresmaller number of data lines in the case of FIG. 66A where the dataliens are arranged in the horizontal direction than the case of FIG. 66Bwhere the data lines are arranged in the vertical direction. Thus,regarding the distance from the display part to the driving IC, thedistance LDa is shorter than the distance LDb. That is, the frame can bemade smaller by arranging the data lines in the horizontal direction.

Regarding the pitch of the scanning lines, pitch PGa of the scanninglines shown in FIG. 66A is larger than pitch PGb of the scanning lineshown in FIG. 66B, since the stereoscopic display unit 235 shown in FIG.66 is substantially a square shape as described above. When the circuitsfor driving a single scanning line are configured with the same numberof TFTs for the scanning-line driving circuits 260 a and 260 b formed byusing the TFTs on the glass substrate, the TFTs need to be disposed inthe horizontal direction in the case of FIG. 66B where the pitch of thescanning lines is narrower. Further, the number of sub-pixels connectedto a single scanning line is larger in the case of FIG. 66B than thecase of FIG. 66A, so that the driving power needs to be increased in thecase of FIG. 66B. Due to the reasons described above, the short side ofthe rectangle showing the scanning-line driving circuit 260 a becomesshorter than the shot side of the scanning-line driving circuit 260 bwhen the scanning-line driving circuits 260 a and 260 b areschematically expressed with rectangles as in FIG. 66. That is, througharranging the data lines along the horizontal direction, the size of theframe can be reduced.

Further, with the landscape (laterally long shape) display part, thescanning lines can be in shorter lengths compared to the case of FIG.66B when the scanning lines are arranged in the vertical direction (Ydirection) as in the case of FIG. 66A. Thus, when the scanning lines areformed with a metal film of a same width for the cases of FIG. 66A andFIG. 66B, delay time of signal transmission from the scanning-linedriving circuit 260 a, 260 b generated due to wiring resistance issmaller in the case of FIG. 66A than the case of FIG. 66B. Therefore,the width of the scanning lines can be made narrower in the case of FIG.66A, thereby making it possible to increase the number of scanning linesper unit area, i.e., making it possible to achieve high resolution.

Furthermore, in a case where the ratio of the horizontal direction andthe vertical direction of the stereoscopic display unit 235 forming thedisplay part 250 is 3:2 or more (e.g., laterally long shape of 16:9),the number of sub-pixels driven by the scanning lines becomes less inthe case of FIG. 66A than in the case of FIG. 66B. Therefore, with thecase of FIG. 66A, the capacitance load becomes smaller than that of FIG.66B, so that the higher resolution can be achieved. Further, in thiscase, the number of data lines becomes less in the case of FIG. 66Awhere the data lines are arranged in parallel. Therefore, when thedisplay part is formed with 1920×1080 of stereoscopic display units, forexample, 3,241 (=1080×3+1) data lines are required for the case of FIG.66A where the data lines are arranged horizontally, while 3,841(=1920×2+1) data lines are required for the case of FIG. 66B where thedata lines are arranged vertically.

When the driving IC of 720 outputs is used for the data-line drivingcircuit 280, six driving ICs are required with the case of FIG. 66Bwhile only five driving ICs are required for the case of FIG. 66A. Thatis, the number of driving ICs can be reduced with the case of FIG. 66Awhere the data lines are arranged horizontally, so that there is aneffect of reducing the cost.

Next, the structure of the sub-pixel 240 which configures the displaypart 250 will be described by referring to the drawing. FIG. 65 is a topview taken from the observer for describing the structure of thesub-pixel 240 of the exemplary embodiment. The sizes and reduced scalesof each structural element are altered as appropriate for securing thevisibility in the drawing. In FIG. 65, the sub-pixels 240 areillustrated in two types of sub-pixels 240 a and 240 b depending on thefacing direction of its shape.

Further, FIG. 65 shows an example in which four sub-pixels forms 2rows×2 columns of the display part 250 shown in FIG. 63. Regarding theXY axes in FIG. 65, X shows the horizontal direction, and Y shows thevertical direction. Furthermore, in order to describe the imageseparating direction, the cylindrical lens 230 a configuring thelenticular lens is illustrated in FIG. 65. The cylindrical lens 230 a isa one-dimensional lens having a semicylindrical convex part, which doesnot exhibit the lens effect for the longitudinal direction but exhibitsthe lens effect for the lateral direction. In this exemplary embodiment,the longitudinal direction of the cylindrical lens 230 a is arrangedalong the Y-axis direction to achieve the lens effect for the X-axisdirection. That is, the image separating direction is the horizontaldirection X.

The aperture part of a total of four sub-pixels 240 a and 240B shown inFIG. 65 are substantially in a trapezoid form surrounded by three datalines Dy−1, Dy, Dy+1 arranged in parallel in the horizontal direction Xand three scanning lines Gx, Gx+1, Gx+2 which are repeatedly bent to thehorizontal direction that is the image separating direction.Hereinafter, the substantially trapezoid form is considered a trapezoid,and the short side out of the parallel two sides along the data linesDy−1, - - - , Dy+1 is called the top side E while the long side iscalled a bottom side F. That is, regarding the sub-pixel 240 a and thesub-pixel 240 b, the trapezoids thereof face towards the oppositedirections form each other with respect to the vertical direction Y,i.e., the directions from the respective top sides E to the respectivebottom sides F are in an opposite relation.

Each of the sub-pixels 240 a and 240 b has a pixel electrode 245, a TFT246, and a storage capacitance 247. The TFT 246 is formed at theintersection between a semiconductor layer 243 whose shape is shown witha thick line in FIG. 65 and the scanning lines Gx, - - - , Gx+2, andincludes a drain electrode, a gate electrode, and a source electrode,not shown. The gate electrode of the TFT 246 is formed at theintersection between the scanning lines Gx, - - - , Gx+2 and thesemiconductor layer 243, and connected to the data lines Dy−1, - - - ,Dy+1 via a contact hole 47. The source electrode is connected to thepixel electrode 245 whose shape is shown with a dotted line in FIG. 65via a contact hole 249.

For the source electrode side of the semiconductor layer 243, a storagecapacitance is formed by disposing a metal film of the same layer asthat of the scanning lines via an insulating film. That is, one of theelectrodes forming the storage capacitance 244 is the semiconductorlayer 243, and the other electrode is the metal film of the same layeras that of the scanning lines. The other electrode of the storagecapacitance 244 is connected to the storage capacitance line CS formedby a metal film of the same layer as that of the data line via thecontact hole 248. The storage capacitance lines CS are arranged alongthe scanning lines and connected to the respective storage capacitances244 of each of the sub-pixels neighboring along the horizontal direction(X direction) via the contact holes 248.

Further, in a first structural example of the sub-pixels 240 shown inFIG. 65, FIG. 67, and FIG. 68, the other electrodes of the storagecapacitances 244 of the sub-pixels neighboring to each other along thevertical direction (Y direction) and connected to the common data lineare connected. Therefore, in the first structural example of thesub-pixels 240, the storage capacitance lines CS are electricallyconnected to the storage capacitances 244 of the sub-pixels lined inboth the horizontal and vertical directions as shown in the equivalentcircuits of FIG. 67 and FIG. 68.

As shown in FIG. 65, regarding the sub-pixel 240 a and the sub-pixel 240b, the shapes, layouts, and connecting relations of the respective pixelelectrodes 245, TFTs 246, contact holes 247, 248, 249, and storagecapacitances 244 are in a point-symmetrical relations with each other.That is, on an XY plane, when the sub-pixel 240 a including eachstructural element is rotated by 180 degrees, the structural shapethereof matches with that of the sub-pixel 240 b.

Further, regarding the aperture parts of the sub-pixels 240 a and 240 barranged in the manner described above, it is desirable for theproportions of the aperture parts and the light-shield parts in theY-axis direction orthogonal to the image separating direction to besubstantially constant for the X-axis direction that is the imageseparating direction. The aperture part is an area contributing todisplay, which is surrounded by the scanning line, the data line, thestorage capacitance line CS, and the semiconductor layer 243. The areaother than the aperture part is the light-shield part. Thus, theproportion of the aperture part and the light-shield part in the Ydirection is the one-dimensional numerical aperture which is obtained bydividing the length of the aperture part when the sub-pixel 240 a or thesub-pixel 240 b is cut in the Y-axis direction by the pixel pitch in theY-axis direction. Hereinafter, the one-dimensional numerical aperture inthe direction orthogonal to the image separating direction is called alongitudinal numerical aperture.

Therefore, “the proportions of the aperture parts and the light-shieldparts in the Y-axis direction are substantially constant for the Xdirection” specifically means that it is so designed that thelongitudinal numerical aperture along the line B-B′ shown in FIG. 65becomes almost equivalent to the longitudinal numerical aperture alongthe line A-A′. The longitudinal numerical aperture along the line B-B′is the value obtained by dividing the length of the aperture of thesub-pixel 240 a along the line B-B′ by the distance between the dataline Dy−1 and Dy, and the longitudinal numerical aperture along the lineA-A′ is the value obtained by dividing the sum of the length of theaperture part of the sub-pixel 240 b and the length of the aperture partof the sub-pixel 40 a along the line A-A′ by the distance between thedata lines Dy−1 and Dy.

The display part of the present invention is configured with thesub-pixels 240 a and 240 b having the above-described structure and thefeatures. In the present invention, two sub-pixels 240 a and 240 bfacing towards the different directions are treated as one structuralunit, and the sub-pixels 240 a and 240 b which are connected to thecommon data line and lined in the vertical direction are called“up-and-down sub-pixel pair”. Specifically, the sub-pixel 240 aconnected to the scanning line Gx+1 and the sub-pixel 240 b connected tothe scanning line Gx, which are connected to the data line Dy shown inFIG. 65 and arranged along the vertical direction are defined as the“up-and-down sub-pixel pair” and treated as the structural unit of thedisplay part.

FIG. 67A is a plan view showing the up-and-down sub-pixel pair, which isa block diagram of the up-and-down sub-pixel pair taken from FIG. 65.FIG. 67B is an equivalent circuit of the up-and-down sub-pixel pairshown in FIG. 67A, in which the scanning lines Gy, - - - , the datalines Dx, the pixel electrodes 245, and the TFTs 246 are shown in samereference numerals. The up-and-down sub-pixel pair shown in FIG. 67 isnamed as the up-and-down sub-pixel pair P2R. FIG. 67C is an illustrationwhich shows FIG. 65 with an equivalent circuit of the up-and-downsub-pixel pair P2R, and the four sub-pixels surrounded by a dotted linecorrespond to FIG. 65. As shown in FIG. 67C, the four sub-pixelsneighboring to each other in FIG. 65 are configured with threeup-and-down sub-pixel pairs. This is because the up-and-down sub-pixelpairs neighboring to each other along the extending direction of thedata lines Dy, - - - are connected to different data lines Dy, - - -with respect to each other.

The reasons why the exemplary embodiment employing the display partconfigured with the up-and-down sub-pixel pairs can achieve the highnumerical aperture and high image quality in the stereoscopic displaydevice will be described. In order to achieve the high numericalaperture and the high image quality, it is necessary to increase thelongitudinal numerical aperture while keeping the constant longitudinalnumerical aperture of the pixels regardless of the positions in theimage separating direction.

First, it is preferable for the scanning lines and the data lines to bedisposed in the periphery of each pixel electrode. This is because theremay be dead space that does not contribute to display generated betweenthe wirings, thereby decreasing the numerical aperture, if there is nopixel electrode between scanning lines or the data lines. In thisexemplary embodiment, as shown in FIG. 65, the scanning lines Gy, - - -and the data lines Dx, - - - are disposed in the periphery of each pixelelectrode 245.

Further, each of the TFTs 246 of the up-and-down sub-pixel pairs isconnected to the respective scanning lines Gx, - - - which are differentfrom each other. Furthermore, regarding the layout of the up-and-downsub-pixel pairs in the horizontal direction, i.e., the layout in theextending direction of the data lines Dy, - - - , the pairs are arrangedneighboring to each other while being shifted from each other by onesub-pixel in the vertical direction. Thus, the up-and-down sub-pixelpairs neighboring to each other in the extending direction of the datalines Dy, - - - are connected to the respective data lines Dy, - - -which are different from each other.

With the layout and the connecting relations described above, it becomespossible to suppress the number of necessary wirings and to improve thenumerical aperture. Further, the scanning lines are bent towards theimage separating direction in order to have the constant longitudinalnumerical aperture regardless of the positions along the imageseparating direction.

As described, the layout of the sub-pixels according to this exemplaryembodiment shown in FIG. 65 takes the up-and-down sub-pixel pair shownin FIG. 67 as the structural unit. The display part of this exemplaryembodiment configured with a plurality of up-and-down sub-pixel pairs iscapable of achieving the high numerical aperture and the high imagequality in the stereoscopic display device.

While the structure of the display part according to the exemplaryembodiment has been described heretofore by referring to the structureshown in FIG. 63 and FIG. 67, it is also possible to employ thestructure of the display part which uses the up-and-down sub-pixel pairP2L that is mirror symmetrical with the up-and-down sub-pixel pair P2Rshown in FIG. 67. FIG. 68A shows a plan view of the structure of theup-and-down sub-pixel pair P2L, and FIG. 68B shows an equivalent circuitof the up-and-down sub-pixel pair P2L. As shown in FIG. 68A, sub-pixels240 a′ and 240 b′ configuring the up-and-down sub-pixel pair P2L areline-symmetrical with the sub-pixels 240 a and 240 b shown in FIG. 67Awith respect to the Y-axis in terms of the shapes, layouts, andconnecting relations of the pixel electrodes 245, the TFTs 246, thecontact holes 247, 248, 249, the semiconductor layer 243, and thestorage capacitances 244 as the structural elements. That is, theup-and-down sub-pixel pair P2R and the up-and-down sub-pixel pair P2Lare line-symmetrical with respect to the Y-axis, line-symmetrical withrespect to the X-axis, and in a relation of the mirror symmetrical withrespect to each other. Therefore, when the up-and-down sub-pixel pairsP2L shown in FIG. 68 configure the display part, it is possible toachieve the same high numerical aperture and high image quality as inthe case of the display part configured with the up-and-down sub-pixelpairs P2R.

Note here that the sub-pixels configuring the up-and-down sub-pixel pairconnected to a common scanning line are called as “upward sub-pixel” andas “downward sub-pixel” according to the facing direction of the bottomside F of the trapezoid, and the terms are used in the followingexplanations. That is, within the up-and-down sub-pixel pair P2R shownin FIG. 67, the sub-pixel 240 a is the “upward sub-pixel”, and thesub-pixel 240 b is the “downward sub-pixel”. Similarly, within theup-and-down sub-pixel pair P2L shown in FIG. 68, the sub-pixel 240 a′ isthe “upward sub-pixel”, and the sub-pixel 240 b′ is the “downwardsub-pixel”. As described above, the optical effects obtained due to thestructures thereof are the same for the up-and-down sub-pixel pairs P2Rand P2L. However, the scanning lines Gx, Gx+1 to which the upwardsub-pixel pair and the downward sub-pixel pair are connected areinverted. That is, while the sub-pixel 240 a is connected to thescanning line Gx+1 and the sub-pixel 240 b is connected to the scanningline Gx, the sub-pixel 240 a′ is connected to the scanning line Gx andthe sub-pixel 240 b′ is connected to the scanning line Gx+1.

The display part of the exemplary embodiment may be configured with theup-and-down sub-pixel pairs P2R or with the up-and-down sub-pixel pairsP2L. Further, the display part may be configured by combining theup-and-down sub-pixel pairs P2R and the up-and-down sub-pixel pairs P2L.Hereinafter, a structural example of the display part 250 of theexemplary embodiment shown in FIG. 63 will be described by referring toa case which displays a first viewpoint image (left-eye image) and asecond viewpoint image (right-eye image) configured with 4 rows×6 columnof pixels. First, input image data will be described by referring toFIG. 69, and the color arranging relation and the image separatingdevice of the display part according to the exemplary embodiment will bedescribed by referring to FIG. 70. A specific example of the displaypart will be provided after the explanations of FIG. 69 and FIG. 70.

FIG. 69 shows charts of image data of the first viewpoint image(left-eye image) and the second viewpoint image (right-eye image)configured with 4 rows×6 columns of pixels. As described above, M1 is anaggregate of the pixel data from M1 (1, 1) RGB, M1 (1, 2) RGB, to M1 (i,j) RGB. M2 is an aggregate of the pixel data from M2 (1, 1) RGB, M2 (1,2) RGB, to M2 (i, j) RGB. “1−i” are the row numbers within the image,and “1−j” are the column numbers within the image. In the case of FIG.69, i=4 and j=6. “RGB” means that it carries the color information of R:red, G: green, and B: blue.

FIG. 70 is an example of the display part 250 which displays two imagesshown in FIG. 69, showing the layout of the image separating device andthe colors of the sub-pixels. Regarding the XY axes in the drawing, Xshows the horizontal direction and Y shows the vertical direction.

In FIG. 70, the sub-pixel is illustrated with a trapezoid, and showsexamples of colors by applying shadings. Specifically, a red (R) colorfilter is arranged on a counter substrate of the sub-pixel lined on thefirst row in the horizontal direction, and the first row functions asthe sub-pixels which display red. A green (G) color filter is arrangedon a counter substrate of the sub-pixel lined on the second row in thehorizontal direction, and the second row functions as the sub-pixelswhich display green. A blue (B) color filter is arranged on a countersubstrate of the sub-pixel lined on the third row in the horizontaldirection, and the third row functions as the sub-pixels which displayblue. In the same manner, the sub-pixels on the fourth row andthereafter function in order of red, green, and blue with a row unit.The exemplary embodiment can be adapted to arbitrary color orders. Forexample, the colors may be arranged in order of blue, green, and redfrom the first row to the third row, and those may be repeated on therows thereafter.

For the image separating device, the cylindrical lens 230 a configuringthe lenticular lens 230 corresponds to the sub-pixels of two-columnunit, and it is arranged in such a manner that the longitudinaldirection thereof exhibiting no lens effect is in parallel to thevertical direction, i.e., in parallel to the columns. Thus, due to thelens effect of the cylindrical lenses 230 a in the X direction, lightrays emitted from the sub-pixels on the even-numbered columns and theodd-numbered columns are separated to different directions from eachother. That is, as described by referring to FIG. 64, at a position awayfrom the lens plane, the light rays are separated into an imageconfigured with the pixels of the even-numbered columns and an imageconfigured with the pixels of odd-numbered columns. As an example, withthis exemplary embodiment in the layouts of FIG. 70 and FIG. 64, thesub-pixels on the even-numbered columns function as the image for theleft eye (first viewpoint) and the sub-pixels on the odd-numberedcolumns function as the image for the right eye.

The color filters and the image separating device are disposed in theabove-described manner, so that one pixel of the input image shown inFIG. 69 is displayed with three sub-pixels of red, green, and blue linedon one column shown in FIG. 70. Specifically, the three sub-pixels onthe first, second, and third rows of the second column display theupper-left corner pixel data: M1 (1, 1) RGB of the left-eye (firstviewpoint) image, and the three sub-pixels on the tenth, eleventh, andtwelfth rows of the eleventh column display the lower-right corner pixeldata: M2 (4, 6) RGB of the right-eye (second viewpoint) image. Further,it is desirable for the sub-pixel pitch of every two columns and thesub-pixel pitch of every three rows to be equal. It is because there isno degradation in the image quality due to the changes in the resolutionunder such pitch condition, since the resolution at the time ofstereoscopic display that has inputted left and right images as parallaximages and the resolution at the time of flat display that has theinputted left and right images as the same images are equal. Further,the same colors are arranged in the direction of the lens effect (i.e.,in the image separating direction), so that there is no color separationgenerated by the image separating device. This makes it possible toprovide the high image quality.

The connecting relations regarding a plurality of sub-pixels arranged inthe matrix shown in FIG. 70 and the scanning lines as well as the datalines, i.e., a specific example for configuring the display part fromthe up-and-down sub-pixel pairs shown in FIG. 67 and FIG. 68, are shownin FIG. 71-FIG. 73 and will be described hereinafter.

FIG. 71 shows a layout pattern 1 of the display part which is formedwith the up-and-down sub-pixel pairs P2R shown in FIG. 67. By having theposition where the upward sub-pixel of the up-and-down sub-pixel pairP2R comes on the first row of the first column as the start point, theup-and-down sub-pixel pairs P2R are disposed in the layout pattern 1. Atthis time, the downward sub-pixels of the up-and-down sub-pixel pairsP2R are disposed on the first row of the even-numbered columns, and theupward sub-pixels of the up-and-down sub-pixel pairs P2R do notconfigure the display part. Similarly, the upward sub-pixels of theup-and-down sub-pixel pairs are disposed on the twelfth row of theeven-numbered columns, and the downward sub-pixels of the up-and-downsub-pixel pairs P2R do not configure the display part. “NP” shown inFIG. 71 shows that sub-pixels that do not configure the display part arenot disposed. Further, FIG. 71 corresponds to FIG. 70, shading in eachpixel shows the display color, and the sub-pixels on the even-numberedcolumns function as the left-eye (first viewpoint) sub-pixels while thesub-pixels on the odd-numbered columns function as the right-eye (secondviewpoint) sub-pixels by the lenticular lens 230 as optical separatingdevice.

FIG. 72 shows a layout pattern 2 of the display part which is formedwith the up-and-down sub-pixel pairs P2L shown in FIG. 68. The layoutpattern 2 shown in FIG. 72 is the same as the layout pattern 1 of FIG.71 except that the up-and-down sub-pixel pairs P2R are changed to theup-and-down sub-pixel pairs P2L, so that explanations thereof areomitted.

FIG. 73 shows an example of layout pattern 3 which configures thedisplay part with a combination of the up-and-down sub-pixel pairs P2Rshown in FIG. 67 and the up-and-down sub-pixel pairs P2L shown in FIG.68. As shown in FIG. 73, on the first column, by having the positionwhere the upward sub-pixel of the up-and-down sub-pixel pair P2L comeson the first row of the first column as the start point, the up-and-downsub-pixel pair P2L and the up-and-down sub-pixel pair P2R are repeatedlydisposed in the Y-axis direction that is the vertical direction. On thesecond column, by having the position where the downward sub-pixel ofthe up-and-down sub-pixel pair P2R comes on the first row of the secondcolumn as the start point, the up-and-down sub-pixel pair P2R and theup-and-down sub-pixel pair P2L are repeatedly disposed in the Y-axisdirection that is the vertical direction. On the third column, by havingthe position where the upward sub-pixel of the up-and-down sub-pixelpair P2R comes on the first row of the third column as the start point,the up-and-down sub-pixel pair P2R and the up-and-down sub-pixel pairP2L are repeatedly disposed in the Y-axis direction that is the verticaldirection. On the fourth column, by having the position where thedownward sub-pixel of the up-and-down sub-pixel pair P2L comes on thefirst row of the fourth column as the start point, the up-and-downsub-pixel pair P2L and the up-and-down sub-pixel pair P2R are repeatedlydisposed in the Y-axis direction that is the vertical direction. On thefifth column and thereafter, the layout pattern from the first column tothe fourth column is repeated. This layout pattern 3 has an effect ofachieving the high image quality in a case where the dot inversiondriving method is applied to the polarity inversion driving method.Details thereof will be described later.

As shown in FIG. 71-FIG. 73, the display part configured with 12 rows×12columns of sub-pixels takes the up-and-down sub-pixel pair as thestructural unit, so that it is necessary to have thirteen data linesfrom D1 to D13 and thirteen scanning lines from G1 to G13. That is, thedisplay part of the exemplary embodiment configured withn-rows×m-columns of sub-pixels is characterized to be driven by (n+1)pieces of data lines and (m+1) pieces of scanning lines. Further, thedisplay part of the exemplary embodiment is formed by having theup-and-down sub-pixel pairs shown in FIG. 67 and FIG. 68 as thestructural unit, and it is possible to be structured with various layoutpatterns other than those shown in FIG. 71-FIG. 73.

However, the difference in the layout pattern influences the polaritydistribution of the display part when the liquid crystal panel is drivenwith the polarity inversion drive. Thus, it is possible to improve theimage quality (e.g., suppression of flickers) due to the polaritydistribution by selecting the layout patterns. However, as can be seenfrom FIG. 71-FIG. 73, in the display part of the present invention, thesub-pixels lined on one row in the horizontal direction are connected totwo data lines alternately, and the sub-pixels lined on one column inthe vertical direction are connected to two scanning lines with aregularity according to the layout pattern. Thus, the polaritydistribution thereof obtained according to the polarity inversiondriving method is different from that of a typical liquid crystal panelin which the sub-pixels on one row are connected to one scanning lineand the sub-pixels on one column are connected to one data line, so thatthe effect obtained thereby is different as well. Hereinafter, detailsof the effects obtained for each of the layout patterns of the exemplaryembodiment when the polarity inversion driving method of the typicalliquid crystal panel is employed will be described.

FIG. 74 shows the polarity distribution of the display part when a gateline inversion drive (1H inversion drive) is employed to the layoutpattern 2 shown in FIG. 72, and shows the data line polarity for eachscanning line of the gate-line inversion drive. In the illustration, “+”and “−” show the positive/negative polarities of the pixel electrodesand the data lines in an arbitrary frame (a period where scanning of allthe scanning lines is done), and negative and positive polarities areinverted in a next frame. The gate line inversion drive is a drivingmethod which inverts the polarity of the data line by each period ofselecting one scanning line, which can reduce the resisting pressure ofa data-line driving circuit (driver IC for driving data line) by beingcombined with the so-called common inversion drive which AC-drives thecommon electrodes on the counter substrate side. Thus, it only requiresa small amount of power consumption.

In the polarity distribution when the gate line inversion drive (1Hinversion drive) is employed to the layout pattern 2 of the exemplaryembodiment, as shown in FIG. 74, the polarities of the sub-pixelsforming an arbitrary row are the same and the polarities of the rowsbefore and after thereof are inverted therefrom. That is, it is the samepolarity distribution as the case where a typical display panel isdriven by the gate line inversion drive (1H inversion drive). Therefore,it is possible to provide the same flicker suppressing effect as thecase where the typical panel is drive by the gate line inversion drivefor the so-called flickers with which the displayed image is seen withflickering due to the luminance difference generated according to thepolarities.

FIG. 75 shows the polarity distribution when the dot inversion drive isemployed to the layout pattern 2 shown in FIG. 72, and shows the dataline polarity for each scanning line of the dot inversion drive. “+” and“−” in the drawing show the polarity as in the case of FIG. 74. As shownin FIG. 75, the dot inversion drive is a driving method which invertsthe polarity by each data line and, further, inverts the polarity of thedata line by every selecting period of one scanning line. It is known asa method which suppresses flickers and achieve the high image quality ina typical liquid crystal panel.

When the dot inversion drive is employed to the layout pattern 2 of theexemplary embodiment, the polarities of the odd-numbered columns are thesame in a row unit (i.e., the polarities on all the odd-numbered columnson one row are the same) as shown in FIG. 75. This is the same for theeven-numbered columns. However, the polarities of the odd-numbered rowsand the even-numbered rows on a same row are inverted. Therefore, foreach of the separated left-eye image and right-eye image, it is possibleto achieve the same flicker suppressing effect as the case of employingthe gate line inversion drive (1H inversion drive) to a typical panel.Furthermore, for observation from a region where the left-eye image andthe right-eye image projected by the image separating device are notseparated but superimposed with each other, the same flicker suppressingeffect as the case of employing the dot inversion drive to the typicalpanel can be achieved.

FIG. 76 shows the polarity distribution when the dot inversion drive isemployed to the layout pattern 3 shown in FIG. 73, and shows the dataline polarity for each scanning line of the dot inversion drive. “+” and“−” in the drawing show the polarity as in the case of FIG. 74.

When the dot inversion drive is employed to the layout pattern 3 of theexemplary embodiment, polarity inversion considering the odd-numberedcolumns is repeated in an odd-numbered column unit such as on the firstrow and the third row, the third row and the fifth row, - - - as shownin FIG. 76. Considering the even-numbered columns, the polarityinversion is repeated in an even-numbered column unit on each row.Further, regarding the polarity distribution within an arbitrary column,the polarities of the pixel electrodes of the up-and-down sub-pixelpairs P2L and the up-and-down sub-pixel pairs P2R neighboring to eachother in the vertical direction are the same, and the polarity isinverted by every two rows. Thus, the long sides of the pixel electrodeseach in a trapezoid form, i.e., the bottom sides of the sub-pixels, cometo be in the same polarities. Therefore, it is possible to suppressabnormal alignment of the liquid crystal molecules in the vicinity ofthe long sides, so that the high image quality can be achieved. Further,for each of the separated left-eye image and right-eye image, thecolumns where the polarities are inverted for every two rows ofsub-pixels in the vertical direction are inverted by a column unit. Thatis, it is possible to achieve the same flicker suppressing effect as thecase of employing the vertical 2-dot inversion drive to a typical panel.

As described above, the combination of the layout pattern of the displaypart and the polarity driving method may be selected as appropriateaccording to the target display quality, the power consumption, and thelike. Further, with the display part of the exemplary embodiment, it isalso possible to employ layout patterns and polarity inversion drivingmethods other than those described above as examples. For example, it ispossible to employ the layout pattern 4 shown in FIG. 77. With thelayout pattern 4, the display part is configured with the up-and-downsub-pixel pairs P2R shown in FIG. 67 by having the position where theupward sub-pixel comes at the first row on the second column as thestart point. The layout pattern 4 shown in FIG. 77 and the layoutpattern 1 shown in FIG. 71 configured with the same up-and-downsub-pixel pairs P2R are in a relation which is being translated in thehorizontal direction by one column.

However, the synthesized image data CM outputted to the data-linedriving circuit 280 shown in FIG. 63 needs to be changed in accordancewith the changes in the layout pattern. The synthesized image data CM isthe image data synthesized from input images M1 and M2, which is thedata inputted to the data-line driving circuit 280 for writing thevoltage to each pixel electrode of the display part 250 which isconfigured with the sub-pixels of n-rows×m-columns. That is, thesynthesized image data CM is the data obtained by rearranging each ofthe pixel data configuring the input image data M1 and M2 to correspondto the data lines from D1 to Dn+1 by each of the scanning lines from G1to Gm+1, and it is expressed with a data structure of (Dn+1) rows and(Gm+1) columns.

Therefore, as can be seen from the layout patterns 1 to 4 shown in FIG.71-FIG. 73 and FIG. 77, the synthesized image data CM becomes differenteven with the sub-pixel designated on a same row and same column sincethe connected data lines or the scanning lines vary depending on thelayout patterns.

As specific examples, FIG. 78-FIG. 81 show the synthesized image datawhen the input image data configured with a plurality of pixel datashown in FIG. 69 is displayed on the display parts of the layoutpatterns 1-4 while the lenticular lens 230 as the image separatingdevice is arranged. FIG. 78-FIG. 81 show the viewpoint, the positions,and colors of the input image data to be supplied to an arbitrary dataline Dy when an arbitrary scanning line Gx is selected. M1 and M2 areviewpoint images, (row number, column number) shows the position withinthe image, and R/G/B shows the color. Further, “x” mark indicates thatthere is no pixel electrode. Naturally, there is no input data M1, M2corresponding to “x” mark and no pixel electrode to which the supplieddata to be reflected, so that the data to be supplied to “x” mark isoptional.

The synthesized image data CM can be generated based on the parametersdetermined by designing, such as color layout of the color filters shownin FIG. 70, the layout patterns shown in FIG. 71-FIG. 73 and FIG. 77,and setting of the image separating device to be described later, andbased on the connection regularity of the up-and-down sub-pixel pairs ina unit of data line as well as the regularity in a unit of scanningline.

The regularity in a unit of data line will be described. In theexemplary embodiment, viewpoint images M1/M2 that the even/odd of thescanning lines are to display are designated. This is because of thereason as follows. That is, in the layout of the up-and-down sub-pixelpairs configuring the display part, the up-and-down sub-pixel pairssharing the same data line cannot be lined side by side on two columnsbut necessarily arranged on every other column. That is, even/odd of thedata lines correspond to even/odd of the columns where the sub-pixelsare arranged in the Y direction. Further, designation of the viewpointimages M1/M2 is determined by a column unit of the sub-pixels accordingto the layout of the image separating device whose image separatingdirection is the X direction.

That is, the factors for determining the even/odd of the scanning linesand the viewpoint images M1/M2 are the layout pattern and the layout ofthe image separating device. For example, in the layout pattern 1 (FIG.71) and the layout pattern 4 (FIG. 77) where the image separatingdevices are disposed in the same manner with respect to the columnnumbers of the sub-pixels, the corresponding relations regardingeven/odd of the data lines and the viewpoint images M1/M2 are invertedfrom each other as it can also be seen from the synthesized image data1, 4 (FIG. 78 and FIG. 81). Further, the image separating device is notlimited to be placed in the manner shown in FIG. 70 but may also beplaced in the manner as shown in FIG. 82, for example. In FIG. 70, asdescribed above, the first column is M2 and the second column is M1,i.e., the sub-pixels on the odd-numbered column are M2 and thesub-pixels on the even-numbered columns are M1. Inversely, in the caseof FIG. 82, the first column is M1 and the second column is M2, i.e.,the sub-pixels on the odd-numbered column are M1 and the sub-pixels onthe even-numbered columns are M2. As described, even/odd of the columnswhere the viewpoint images M1/M2 are displayed is determined dependingon the layout of the image separating device.

The relation between the even/odd of the data lines and the viewpointimages M1/M2 determined in the manner described above is summarized inFIG. 83. In FIG. 83, a viewpoint of an input image to which theodd-numbered data line corresponds is shown with “v1”, and a viewpointof an input image to which the even-numbered data line corresponds isshown with “v2”. The corresponding relations regarding even/odd of thedata lines and the viewpoints images M1/M2 described by referring to thecases of the layout pattern 1 (FIG. 71) and the layout pattern 4 (FIG.77) is determined whether the sub-pixel located on the first row of thefirst column on the display part is the upward sub-pixel or the downwardsub-pixel. It is assumed here that the facing directions (upward ordownward) of the sub-pixel to be placed on the first row of the firstcolumn is a variable “u”, and the sub-pixel on the first row of thefirst column is the upward sub-pixel when u=0 while the sub-pixel on thefirst row of the first column is the downward sub-pixel when u=1. Forexample, FIG. 83 shows that, when the image separating device is sodisposed that the odd-numbered columns of the display part are M1 andthe even-numbered columns are M2, and that the sub-pixel on the firstrow of the first column in the display part is the upward sub-pixel(u=0), “v1=2 and v2=1” applies. That is, the viewpoint images on theodd-numbered data lines are M2, and the viewpoint images on theeven-numbered data lines are M1.

R/G/B to be the color of the first row is determined by the colorfilter. One data line is connected to the sub-pixels of two rows. Thus,the regularity of the colors corresponding to an arbitrary data line isdetermined when the color on the first row determined by the colorfilter and the order of colors are determined. For example, as shown inthe layout patterns 1-3 (FIG. 71-FIG. 73) and the layout pattern 4 (FIG.77) described above, in the coloring order of R(red), G(green), andB(blue) continued from the first row, the sub-pixels connected to thedata line D3 are G and B, and the sub-pixels connected to the data lineD4 are B and R. That is, when the coloring order is determined, the twocolors corresponding to arbitrary data line are determined. Consideringthe repetition of three colors of RGB formed by the color filters inaddition to the repetition of the correspondence of the viewpoint imagesbased on even/odd of data lines described above, there is a periodicityof six data line unit in the regularity of designating the input imagedata.

Further, an arbitrary data line Dy is connected to sub-pixels on the(y−1)-th row and y-th row of the display part (note that there is no0-th row and (n+1)-th row in the display part configured with sub-pixelsof n-rows and m-columns). For the connections between the data lines andthe sub-pixels, the upward pixel of the up-and-down sub-pixel pairconnected to Dy is on the (y−1)-th row and the downward pixel is on they-th row. Therefore, as described above, the row number is alsodesignated in addition to designation of the viewpoint number “k” andthe colors (R/G/B) in the input image data “Mk (row, column) RGB” shownin FIG. 69. Hereinafter, the row number of arbitrary pixel data of inputimage data is expressed as “Iy”, and the column number thereof isexpressed as “Ix”.

The relation between the arbitrary data line Dy and the input image datadescribed above are summarized in FIG. 84. When the data line number isexpressed by using an arbitrary natural number “p”, the row number Iy ofthe input image data corresponding to the data line Dy(p) is determinedaccording to “p” as shown in FIG. 84. Further, the viewpoint numbers ofthe input image data corresponding to the data line Dy(p) are shown byusing “v1” and “v2” which are determined by FIG. 83. Furthermore, thecolors of the input image data corresponding to the data line Dy(p) areput into parameters and shown as C1 for the color on the first row ofthe display part, C2 for the color on the second row, C3 for the coloron the third row, C1 for the color on the fourth row, - - - . When thecolors are in order of RGB from the first row, the colors are C1=R,C2=G, and C3=B.

Next, the regularity in a unit of scanning line will be described. Ascan be seen from the layout patterns 1-4 shown in FIG. 71-FIG. 73 andFIG. 77, an arbitrary scanning line Gx is connected to sub-pixels on twocolumns of (x−1)-th column and x-th column (note that there is no 0-thcolumn and (m+1)-th column in the display part configured withsub-pixels of n-rows and m-columns). With the image separating device,the sub-pixels on each column correspond to the viewpoint images M1 andM2. Thus, the viewpoint image on the (x−1)-th column and the viewpointimage on the x-th column to which the scanning line Gx is connected aredetermined based on the layout of the image separating device andeven/odd of the scanning lines. For example, in the cases of FIG.71-FIG. 73 and FIG. 77 where the image separating devices are arrangedas in FIG. 70, the (x−1)-th column corresponds to the viewpoint imageM1, and the x-th column corresponds to the viewpoint image M2 when thescanning line Gx is the odd-numbered scanning line. When the scanningline Gx is the even-numbered scanning line, the (x−1)-th columncorresponds to the viewpoint image M2, and the x-th column correspondsto the viewpoint image M1. Further, when the image separating device isplaced as in FIG. 82, for example, the (x−1)-th column corresponds tothe viewpoint image M2, and the x-th column corresponds to the viewpointimage M1 when the scanning line Gx is the odd-numbered scanning line.When the scanning line Gx is the even-numbered scanning line, the(x−1)-th column corresponds to the viewpoint image M1, and the x-thcolumn corresponds to the viewpoint image M2.

As described above, an arbitrary scanning line Gx designates theviewpoint number “k” as well as the column number of the input imagedata “Mk (row, column) RGB” shown in FIG. 69. FIG. 85 shows the scanninglines, the viewpoint images, and the column numbers of the layoutpatterns 1-4 shown in FIG. 71-FIG. 73 and FIG. 77. Note here that theviewpoint images M1 and M2 shown in FIG. 85 are determined by the layoutof the image separating device and even/odd of the data lines. That is,when even/odd of the data line can be known, the viewpoint image can bedetermined from FIG. 83. Therefore, the relation regarding the columnnumber of the input image data on even/odd data line with respect to thearbitrary scanning line Gx may be derived. From FIG. 85, it can be seenthat there is a periodicity of every two scanning lines between thecolumn number of the input image data corresponding to the (x−1)-thcolumn of the display part and the column number of the input image datacorresponding to the x-th column of the display part. Thus, the scanningline number is expressed by using an arbitrary natural number “q”, andthe column number “Ix” of the input image data corresponding to thescanning line Gx(q) is expressed with “q”.

FIG. 86 shows the summary of the relation regarding the scanning linesand the column numbers of the input image data by using the naturalnumber “q” mentioned above. Note here that the (x−1)-th column and thex-th column of the display part to which the arbitrary scanning line Gxis connected can be expressed with even/odd of the scanning line, thevariable “u” showing the “upward” or “downward” of the sub-pixelsdisposed on the first row of the first column, and even/odd of the dataline by using the relation with respect to the viewpoint images. Forexample, in the layout patterns 1-3 shown in FIG. 71-FIG. 73, “u=0”. Thesub-pixel on the (x−1)-th column to which the even-numbered scanningline Gx is connected is connected to the even-numbered data line, andthe sub-pixel on the x-th column to which the even-numbered scanningline Gx is connected is connected to the odd-numbered data line.Further, in the layout patterns 1-3 shown in FIG. 71-FIG. 73 where“u=0”, the sub-pixel on the (x−1)-th column to which the odd-numberedscanning line Gx is connected is connected to the odd-numbered dataline, and the sub-pixel on the x-th column to which the odd-numberedscanning line Gx is connected is connected to the even-numbered dataline. Furthermore, in the layout pattern 4 shown in FIG. 77, forexample, “u=1”. The sub-pixel on the (x−1)-th column to which theeven-numbered scanning line Gx is connected is connected to theodd-numbered data line, and the sub-pixel on the x-th column to whichthe even-numbered scanning line Gx is connected is connected to theeven-numbered data line. Further, in the case of FIG. 77 where “u=1”,the sub-pixel on the (x−1)-th column to which the odd-numbered scanningline Gx is connected is connected to the even-numbered data line, andthe sub-pixel on the x-th column to which the odd-numbered scanning lineGx is connected is connected to the odd-numbered data line. When thearbitrary natural number “q” is used and the above-described relationsare employed to FIG. 85, the column numbers of the input image datacorresponding to the scanning line Gx(q) can be determined by “q” asshown in FIG. 86.

Heretofore, the relations regarding the viewpoints of input image datacorresponding to the upward/downward sub-pixels connected to arbitrarydata lines, the column numbers, and the colors are shown in FIG. 83 andFIG. 84, and the relation regarding arbitrary scanning lines and thecolumn numbers of the input image data is shown in FIG. 86. Therefore,when the sub-pixel connected to an arbitrary data line Dy and scanningline Gx can be identified whether it is the upward sub-pixel or thedownward sub-pixel, it is possible to generate synthesized image dataCM. That is, it is necessary to have information regarding the layoutpattern.

As has been described earlier, the display part of the exemplaryembodiment uses the up-and-down sub-pixel pair as the structural unit,and is formed with the up-and-down sub-pixel pairs P2R shown in FIG. 67,the up-and-down sub-pixel pairs P2L shown in FIG. 68, or a combinationof the up-and-down sub-pixel pairs P2R and the up-and-down sub-pixelpairs P2L. Therefore, as the information regarding the layout patterns,it simply needs to store whether the up-and-down pixel connected to anarbitrary data line Dy and an arbitrary scanning line Gx is theup-and-down sub-pixel pair P2R or P2L.

FIG. 87 shows the up-and-down sub-pixel pairs P2R and P2L connected tothe data line Dy and the scanning line Gx in the case of the layoutpattern 3 shown in FIG. 73. In FIG. 87, the up-and-down sub-pixel pairP2R is shown as “0”, the up-and-down sub-pixel pair P2L is shown as “1”,and “x” mark means that there is no connected up-and-down sub-pixelpair. Thus, the vale of a section shown with “x”, e.g., the value of(D1, G1), may be “0” or “1”. With this, in the case of FIG. 87, there isa repeated pattern with a unit of four data lines and a unit of fourgate lines.

FIG. 88 shows a pattern of the up-and-down sub-pixel pairs P2R and P2Lwith the layout pattern 3 while paying attention to the repetitionsdescribed above. In FIG. 88, the pattern is shown with lower bits byexpressing Dy and Gx with binary numbers. Also, FIG. 88 shows patternsof the up-and-down sub-pixel pairs P2R and P2L with the layout patterns1, 4, and 2 by using the lower 2 bits. The connecting relations of thedata lines Dy, the scanning lines Gx, and the up-and-down sub-pixelpairs in accordance with the layout patterns shown in FIG. 88 are storedas lookup tables LUT which take Dy and Gx as variables, and returnvalues of “0” and “1”. With this, it is possible to identify whether theup-and-down sub-pixel pair connected to an arbitrary data line Dy and anarbitrary scanning line Gx is P2R or P2L from LUT (Dy, Gx).

By combining LUT (Dy, Gx) shown in FIG. 88 with even/odd of the scanninglines and the data liens, the facing directions (upward/downward) of thesub-pixels to be connected to an arbitrary scanning line and data linecan be determined as shown in FIG. 89. When the upward pixels anddownward pixels shown in FIG. 84 are replaced with LUT (Dy, Gx) andeven/odd of the scanning lines, the relation shown in FIG. 90 can beobtained.

As described above, the synthesized image data CM can be generated fromthe information shown in FIG. 83, FIG. 88 and the regularities shown inFIG. 86, FIG. 89.

FIG. 91 summarizes the parameter variables required for generating thesynthesized image data and specific example of the variable contents(layout pattern 3). At least one set of parameter sets shown in FIG. 91is saved in the parameter storage device 340 shown in FIG. 63 to be usedfor generating the synthesized image data. As described, through savingthe parameters required for generating the synthesized image data, it ispossible to correspond to changes in the design of the display part bychanging the parameters. It is also possible to switch the parametersaccording to the changes in the display module to be driven by saving aplurality of parameters. This makes it possible to reduce the number ofsteps for changing the parameters.

(Explanations of Actions)

Actions of the exemplary embodiment will be described by referring tothe drawings. FIG. 92-FIG. 100 are flowcharts showing an example ofdisplay action of the display device according to the exemplaryembodiment.

(Step S1000)

As shown in FIG. 92, when the action of the display device according tothe exemplary embodiment is started, various kinds of parametersrequired for generating the synthesized image are read from theparameter storage device 340 shown in FIG. 63. The viewpoint “v1” of theinput image to which the odd-numbered data line corresponds, theviewpoint “v2” of the input image to which the even-numbered data linecorresponds, colors CL1, CL2, CL3 which show the color order by thecolor filters in a row unit, the row number “n” and the column number“m” having a sub-pixel of the display part 250 as a unit, “u” whichshows the facing direction of the sub-pixel t positioned on the firstrow of the first column of the display part 250, and LUT showing thelayout pattern of the up-and-down sub-pixel pairs configuring thedisplay part 250 are set to the readout control device 330

(Step S2000)

The input image data having the image data M1, M2 configured with imagedata of i-rows and j-columns and the synchronous signals are inputted tothe writing control device 310 from outside. The writing control device310 sequentially generates addressees of the inputted pixel data from M1(1, 1) RGB to M1 (i, j) RGB and from M2 (1, 1) RGB to M2 (i, j) RGB byutilizing the synchronous signals, and stores the addresses in the imagememory 320. Therefore, it is possible to select arbitrary viewpointimages M1/M2, positions (row Iy, column Ix), each color (R/G/B)luminance data from the input image data stored in the image memory 320by designation of the address. That is, data readout can be done via theaddresses given by the writing control device 310. Explanationsregarding a specific address map inside the memory are omitted, since itonly needs to be able to identify the viewpoint images of the inputimage data, position, and each color luminance data. The image memory320 has regions at least for two screens of the synthesized image datato be outputted, and alternately uses the readout screen region and thewrite screen region.

(Step S3000)

The input image data (viewpoint images M1, M2) stored in the imagememory 320 shown in FIG. 63 are read out by the readout control device330 according to a prescribed pattern, rearranging processing isperformed, and the synthesized image data CM is outputted to thedata-line driving circuit 280 of the display panel 220. The actions ofsynthesized image output processing will be described separately byreferring to a flowchart shown in FIG. 93.

(Step S8000)

When the readout and rearranging processing is completed, one-framedisplay action is completed. The procedure is returned to step S2000,and the above-described actions are repeated.

In FIG. 92, the input image writing processing (step S2000) and thereadout and rearranging processing (step S3000) are illustrated in orderfor convenience' sake. However, as has been described in step S1100, theimage memory 320 has the regions for two screens. Therefore, actually,the writing processing in a given frame Fn and readout and rearrangingprocessing of a frame Fn−1 already written to the image memory areexecuted in parallel.

Next, actions of the synthesized image output processing will bedescribed by referring to FIG. 93. FIG. 93 is a flowchart showing theprocessing contents of step S3000 shown in FIG. 92. FIG. 93 mainly showsthe count processing for one frame having a scanning line as a unit.

(Step S3100)

“1” is given to the variables “Gx”, “q”, and “t” as an initial value.“Gx” is the variable for counting the number of scanning lines, and thecount value corresponds to the scanning line selected in the displaypanel. Further, “t” is the variable for counting even/odd of thescanning lines, i.e., the cycle of two scanning lines, and “q” is thevariable used for designating the column number Ix of the input imagedata as shown in FIG. 86, which is incremented by 1 every time “t”counts “2”.

(Step S4000)

The synthesized image data for one line corresponding to the scanningline Gx of the display panel is outputted. The actions of line dataoutput processing will be described separately by referring to aflowchart shown in FIG. 94.

(Step S7100)

It is judged whether or not the count value of Gx has reached the lastscanning line Gm+1 of the display part. For the judgment, the columnnumber “m” of the display part set in step S1000 shown in FIG. 92 isused. When it has not reached to “m+1”, it is judged as Yes and theprocedure is advanced to step S7200. When it is “m+1”, the judgment isNo and the procedure of FIG. 93 is ended. Then, the procedure isadvanced to step S8000 of FIG. 92.

(Step S7200)

“1” is added to each of the count values of “t” and “Gx” in accordancewith the horizontal synchronous signals from the timing control device350 shown in FIG. 63.

(Step S7300)

Judgment by the count value of “t” is executed. When “t is larger than2, it is judged as Yes and the procedure is advanced to step S7400. When“t” is 2 or less, the judgment is No and the procedure is advanced tostep S4000.

(Step S7400)

The count value of “t” is returned to 1, the count value of “q” isincremented by 1, and the procedure is advanced to step S4000.

Next, actions of line data output processing will be described byreferring to FIG. 94. FIG. 94 is a flowchart showing the processingcontents of step S4000 shown in FIG. 93. FIG. 93 mainly shows the countprocessing for one line having a data line as a unit.

(Step S4100)

“1” is given to the variables “Dy”, “p”, and “s” as an initial value.“Dy” is the variable for counting the number of data line. Further, “s”is the variable when counting the cycle of six data lines, and “s” isthe variable used for designating the row number Iy of the input imagedata as shown in FIG. 90, which is incremented by 1 every time “s”counts “6”.

(Step S5000)

The input image data corresponding to the scanning line Gx and the dataline Dy is read out from the image memory 320, the input image data isrearranged in the data order according to the display panel, and therearranged data is stored in a line memory L in the count value order ofDy. The actions of the readout and rearranging processing will bedescribed separately by referring to a flowchart shown in FIG. 95.

(Step S6000)

It is judged whether or not the count value of Dy has reached the entiredata line number Dn+1 of the display part. For the judgment, the rownumber “n” of the display part set in step S1000 shown in FIG. 92 isused. When it has not reached to “n+1”, it is judged as Yes and theprocedure is advanced to step S6100. When the count value of Dy is“n+1”, the judgment is No and the procedure is advanced to step S7000.

(Step S6100)

“1” is added to each of the count values of “s” and “Dy” in accordancewith the signals from the timing control device 350 shown in FIG. 63.

(Step S6200)

Judgment by the count value of “s” is executed. When “s” is larger than6, it is judged as Yes and the procedure is advanced to step S6300. When“t” is 6 or less, the judgment is No and the procedure is advanced tostep S5000.

(Step S6300)

The count value of “s” is returned to 1, the count value of “p” isincremented by 1, and the procedure is advanced to step S5000.

(Step S7000)

The synthesized image data CM (Gx) for one line of the scanning line Gxstored in the line memory L is outputted to the data-line drivingcircuit 280 shown in FIG. 63 by synchronizing with the control signal281 for data-line driving circuit generated by the timing control device350. The line data output processing is ended by completing step S7000,and the procedure is advanced to step 7100 shown in FIG. 93. The actionsof the procedure are so described that the procedure is advanced to stepS7100 of FIG. 93 after completing the processing step S7000. However, itis so described for convenience' sake, and the output processing of thesynthesized image data (Gx) by step S7000 and the processing of stepS7100 and thereafter shown in FIG. 93 may be executed in parallel.

Next, actions of the readout and rearranging processing will bedescribed by referring to FIG. 95. FIG. 95 is a flowchart showing theprocessing contents of step S5000 shown in FIG. 94. FIG. 93 mainly showsbranching processing for the count values “s” of the cycle of six datalines.

(Steps S5010-S5050)

This is the branching processing executed according to the count value“s”. The procedure is advanced to step S5100 when “s=1”, advanced tostep S5200 when “s=2”, advanced to step S5300 when “s=3”, advanced tostep S5400 when “s=4”, advanced to step S5500 when “s=5”, and advancedto step S5600 when “s” takes other values (s=6).

(Steps S5100-S5600)

The pixel data corresponding to the sub-pixels connected to the displaypanel (Dy, Gx) is designated from the input image data within the imagememory in accordance with the count value “s”. Actions of the input datadesignation processing are shown in each of drawings FIG. 96-FIG. 101.With the input data designation processing, the viewpoint number k ofthe input image data corresponding to the data line Dy and the scanningline Gx, the row number Iy, the column number Ix, and the colors CL aredetermined.

(Step S5700)

It is judged whether or not the row number Iy and the column number Ixof the designated input image data are the sub-pixels that do not existon the display part. For the judgment, the row number “n” and the columnnumber “m” of the display part set in step S1000 shown in FIG. 92 areused. Under each of the conditions “Ix=0”, “Ix=m/2+1”, “Iy=0” or“Iy=n/3+1”, there is no corresponding sub-pixel on the display part.Therefore, under any of the above conditions, it is judged as Yes andthe procedure is advanced to step S5710. Under a state that does notmeet any of those conditions, it is judged as No and the procedure isadvanced to step S5720.

(Step S5710)

This is the processing executed in a case where there is nocorresponding sub-pixel on the display part on the Iy row and Ix columnof the designated input image data. Thus, even though it is notreflected upon display, “z” is outputted as data PD of the data line Dyon the scanning line Gx. As an example, “z” is set as “0”.

(Step S5720)

The corresponding address in the image memory is designated based on theviewpoint number “k” of the designated input image data, the row numberIy, the column number Ix, and the colors CL. By designation of theaddress, the data PD=M(k) (Iy, Ix) (CL) of the data line Dy on thescanning line Gx is read out from the image memory.

(Step S5800)

The data PD of the data line Dy on the scanning line Gx is stored in theline buffer L which stores data of one scanning line. When the data PDis stored to the line buffer, the readout and rearranging processing isended. Then, the procedure is advanced to step S6000 shown in FIG. 94where it is judged whether or not the data storage processing to theline buffer L is completed for all the data lines (n+1) connected to thescanning line Gx.

Next, actions of input data designation processing will be described byreferring to FIG. 96-FIG. 101. FIG. 96 shows the processing fordesignating the viewpoint number “k” of the input image data, the rownumber Iy, the column number Ix, and the color CL when the count value“s” showing the count processing of FIG. 94 is 1. For the designation,used are the parameters “v1”, “v2”, “C1”, “C2”, “C3”, “u”, “LUT” read instep S1000 shown in FIG. 92, variables “Gx”, “q”, “t”, showing the countprocessing of FIG. 93, and the variables “Dy”, “p” showing the countprocessing of FIG. 94.

(Step S5110)

It is judged whether the up-and-down sub-pixel pair connected to thescanning line Gy and the data line Dy is P2L or P2R. As the judgmentcondition, “LUT (Dy, Gx)=0” is used as an example. When judged as Yes(the up-and-down sub-pixel pair is P2R), the procedure is advanced tostep S5111. When judged as No (the up-and-down sub-pixel pair is P2L),the procedure is advanced to step S5112.

(Steps S5111, S5112)

Even/odd of the scanning line Gx is judged. As the judgment condition,“t=1” with which the scanning line Gx becomes an odd-numbered line isused as an example. The odd number and even number of the scanning lineis related to designation of the column number Ix as shown in FIG. 86and related to designation of the row number Iy as well as the color CLas shown in FIG. 90. When judged as Yes (the scanning line is anodd-numbered scanning line), the procedure is advanced from step S5111to step S5121, and advanced from step S5112 to step S5122 to performjudgment processing of “u” for designating the column number Ix. In themeantime, when the judgment is No, the scanning line is an even-numberedscanning line. In that case, as shown in FIG. 86, the column number Ixdoes not depend on “u”. Therefore, when judged as No, the procedure isadvanced from step S5111 to step S5133, and advanced from step S5112 tostep S5132 to perform designation processing of the column number Ix.Note here that, as shown in FIG. 92, designation of the row number Iyand the color CL according to the value of LUT becomes switcheddepending on even/odd of the scanning line. Thus, as shown in FIG. 96,the processing flow becomes crossed.

(Steps S5121, S5122)

In order to designate the column number Ix according to FIG. 86, it isjudged whether the sub-pixel on the first row of the first column is theupward pixel or the downward pixel. As the judgment condition, “u=0” issued. When the judgment is Yes (the upward pixel), the procedure isadvanced from step S5121 to step S5131 and advanced from step S5122 tostep S5133. In the meantime, when the judgment is No, the procedure isadvanced from step S5121 to step S5132 and advanced from step S5122 tostep S5134.

(Steps S5131, S5134)

The column number Iy of the input image data is designated by using “q”,respectively. Since “s=1”, the data line is an odd-numbered data line.Thus, the column number is determined by the conditional branching andFIG. 86. The procedure is advanced from steps S5131, S5132 to stepS5141, and advanced from step S5133, S5134 to step S5142.

(Steps S5141, S5142)

Based on the relation shown in FIG. 90, the viewpoint number “k” of theinput image data, the row number Ix, and the color CL are designated.Note that “s=1” correspond to data line 6p−5 in FIG. 90. The row numberIx is designated by using “p”. The viewpoint number “k” and the color CLare designated by the parameters selected as in steps S5141, S5142 fromthe parameters read in step S1000 of FIG. 92. In the manner describedabove, the viewpoint number “k” of the input image data, the row numberIx, and the color CL are designated, and the input data designationprocessing is ended. Then, the procedure is advanced to step S5770 shownin FIG. 95.

FIG. 97 shows the processing for designating the viewpoint number “k” ofthe input image data, the row number Ix, and the color CL when the countvalue “s” showing the count processing of FIG. 94 is 2. As shown in FIG.97, designation of the parameters selected as the viewpoint number “k”and the color CL, and the row number Ix are different from the case ofFIG. 96, the processing flow is the same as the case when “s=1”.However, when “s” is 2, the data lien is an even-numbered data line.This, designation of the column number Iy as in FIG. 86 is differentfrom the case of FIG. 96. Therefore, for the judgment conditionregarding whether the sub-pixel on the first row of the first column ofthe display part is the upward pixel or the downward pixel, “u=1” isused unlike the case of FIG. 96.

Similarly, FIG. 98 is a flowchart showing the processing for designatingthe viewpoint number “k” of the input image data, the row number Ix, andthe color CL when the count value “s” is 3, FIG. 99 is a flowchart whenthe count value “s” is 4, FIG. 100 is a flowchart when the count value“s” is 5, and FIG. 101 is a flowchart when the count value “s” is 6. Theprocessing flows thereof are the same as the case of “s=1”, so thatexplanations thereof are omitted.

As described above, the processing described by using FIG. 92-FIG. 100makes it possible to execute the actions for generating and displayingthe synthesized image data in accordance with the display module fromthe input image data inputted from outside on the display device of theexemplary embodiment. The processing described above is merely anexample of the exemplary embodiment, and the exemplary embodiment is notlimited only to such processing. For example, the order of the branchingprocessing executed for designating the viewpoint number “k” of theinput image data written in the image memory, the row number Iy, thecolumn number Ix, and the color CL may not have to be in the order shownin FIG. 96-FIG. 101 as longs as the designation result of the input datadesignation processing matches with FIG. 86 and FIG. 90. Further, inFIG. 95, for example, the sub-pixel which does not exist on the displaypart is judged, and “z=0” is supplied as the data PD. However, the datasupplied as “z” does not contribute to the display and is invalid sincethe sub-pixel does not exist on the display part. Therefore, when thereis enough capacitance in the image memory, the judgment processingitself may be omitted, address of the invalid data may be set, andmemory readout processing may be executed. In that case, steps S5700,S5710 of FIG. 95 can be omitted, and step S5720 can be executed as thememory readout processing. Thus, the processing amount can besuppressed, even though the image memory becomes increased.

The structures and operations of the ninth exemplary embodiment of thepresent invention have been described heretofore.

FIG. 102A is a block diagram showing a terminal device that is anexample to which the display device of the exemplary embodiment isapplied. The terminal device 500A shown in FIG. 102A is configured,including an input device 501, a storage device 502, an arithmeticcalculator 503, an external interface 504, a display device 505A of theexemplary embodiment, and the like. As described above, the displaydevice 505A includes a display controller 300, so that data for twoimages may be transmitted as in a case where the image data istransmitted from the arithmetic calculator 503 to a typical displaydevice. The two pieces of image data may be the image data which aredisplayed two dimensionally on a typical display panel. That is, thedisplay device 505A of the exemplary embodiment includes the displaycontroller 300, so that the arithmetic calculator 503 does not need toexecute any special processing on the two pieces of images data to beoutputted. Thus, there is no load imposed upon the arithmetic calculator503 in this respect. Further, the display controller 300 of theexemplary embodiment includes an image memory 320 (FIG. 63). Thus, thetwo pieces of image data outputted by the arithmetic calculator 503 arenot limited to be in a form where the image data are lined in thehorizontal direction whose image is shown in FIG. 102 (the so-calledside-by-side form), but may be in a form where the image data are linedin the vertical direction or in a frame time-division form.

With the terminal device to which the present invention is applied, thedisplay controller is not limited to the structure to be loaded on thedisplay device as in the case of FIG. 102A. For example, the displaycontroller may be loaded not on the display device but on a circuitsubstrate where the arithmetic calculator 503 is loaded.

Further, as in the case of a terminal device 500B shown in FIG. 120B,the processing procedure of the display controller may be put into aprogram and the display controller 300 may be provided to the arithmeticcalculator 503.

The terminal devices shown in FIG. 102A and FIG. 102B can deal with acase where a display module A is changed to a display module B (notshown) without changing the display controller 300. For example, thedisplay module 400B (not shown) is different from the display module400A in terms of the layout of the image separating device, the order ofthe color filters, the layout patterns of the up-and-down sub-pixelpairs, and the like. Specifications of the display modules aredetermined depending on the various factors required to the displaydevices from the terminal devices to be loaded, such as the imagequality, cost, size, and resolution. The display controller 300according to the present invention includes the parameter storage device340 (FIG. 63). Thus, it is possible to deal with the changes in thedisplay module by rewriting or selecting the parameters, and the samedisplay controller 300 can be used. This makes it possible to decreasethe number of designing steps for the display device and the terminaldevice, and to decrease the cost therefore.

While the exemplary embodiment has been described by referring to thecase of the stereoscopic display device which provides different imagesto both eyes of the observer. The present invention may also be appliedto a 2-viewpoint display device which provides different imagesdepending on the observing positions.

Further, while the exemplary embodiment has been described by referringto the case where the lenticular lens is used for the optical imageseparating device and the lenticular lens is disposed on the observerside of the display panel, the lenticular lens may be disposed on theopposite side from the observer. Furthermore, as the optical imageseparating device, it is also possible to employ a parallax barrier.Moreover, it is also possible to provide, on a display panel, asubstrate where polarization elements corresponding to each sub-pixelfor displaying the viewpoint images M1, M2 are arranged in such a mannerthat the light emitted from the sub-pixels comes under differentpolarization state for each viewpoint image, and such display panel maybe applied to an eye-glass type stereoscopic image display device.

Further, the structure of the sub-pixel 40 (FIG. 63) is not limited tothe first example (referred to as “first sub-pixel” and “firstup-and-down sub-pixel pair” hereinafter) shown in FIG. 65-FIG. 68, but asecond example (referred to as “second sub-pixel” and “secondup-and-down sub-pixel pair” hereinafter) shown in FIG. 103 and FIG. 104can also be applied. FIG. 103 shows the structure of the secondup-and-down sub-pixel pair P2R and equivalent circuits, and FIG. 104shows the structure of the second up-and-down sub-pixel pair P2L andequivalent circuits. In those drawings, the sizes and reduced scales ofeach structural element are altered as appropriate for securing thevisibility in the drawing.

The difference between the first sub-pixel and the second sub-pixel thatis shown in FIG. 103 and FIG. 104 is the layout of the storagecapacitance lines. In the second sub-pixel, the storage capacitance lineCSx is formed on a metal film that is on the same layer as that of thescanning lines. Thus, among the electrodes that form a storagecapacitance 444, the electrode on the opposite side of a semiconductorlayer 443 and the storage capacitance CSx can be formed with thesame-layer metal film. Further, by disposing the storage capacitance CSxbetween the scanning lines perpendicularly with respect to the dataline, the contact hole 448 (FIG. 67 and the like) which is necessary inthe first sub-pixel can be omitted. The contact hole can be omitted withthe second sub-pixel, so that micronization of the sub-pixels can beachieved. This makes it possible to achieve high resolution of thedisplay part.

In the first sub-pixel, as shown in FIG. 67 and the like, the storagecapacitances 44 of the sub-pixels lined in the horizontal direction areconnected via the storage capacitance lines CS. In the meantime, in thesecond sub-pixel, the storage capacitances 444 of the sub-pixels linedin the vertical direction are connected via the storage capacitancelines CSx. Thus, with the second sub-pixels, it is necessary to becautious about the storage capacitance lines connected in a column unitand the polarity of the voltage written to the sub-pixels, when applyingthe polarity inversion drive to a liquid crystal panel.

For example, in a case where a dot inversion drive is employed to thelayout pattern 3 shown in FIG. 76, when an arbitrary scanning line(e.g., Gx+1 (FIG. 103C, FIG. 104C) is selected, the polarities writtento the sub-pixels become the same by a column unit i.e., by a storagecapacitance line unit (e.g., by CSx, CSx+1). When the polarities writtento the sub-pixels connected to the storage capacitance line becomes thesame at the gate selection timing, potential fluctuations in the storagecapacitance lines generated by the written voltages become uniform aswell. This generates crosstalk in the extending direction of the storagecapacitance lines, thereby deteriorating the displayed image quality.

Therefore, when the second sub-pixels shown in FIG. 103 and FIG. 104 areused, it is preferable to employ a 2-dot inversion drive for thepolarity inversion drive method. FIG. 105 shows the polaritydistribution of the display part when the 2-dot inversion drive isemployed to the layout pattern 2 shown in FIG. 82, and the data linepolarity for each scanning line of the 2-dot inversion drive. “+” and“−” in the drawing show the polarity as in the case of FIG. 74. As shownin FIG. 105, the 2-dot inversion drive is a driving method which invertsthe polarity by every two data lines and, further, inverts the polarityof the data line every selecting period of single scanning line. In thiscase, when an arbitrary scanning line Gx+1 is selected, the polaritiesof the sub-pixels to which the voltage is written become different in aunit of x column or a unit of (x+1) columns. That is, there are bothpositive and negative polarities for the polarities written to thesub-pixels connected to the storage capacitance lines at the gateselecting timing. Thus, the potential fluctuations in the storagecapacitance lines generated due to the written voltages can be set offand uniformanized, which provides an effect of suppressing crosstalkgenerated in the extending direction of the storage capacitance line.

In the polarity distribution shown in FIG. 105, the polarities are thesame in a row unit. Thus, it is possible to achieve the same flickersuppressing effect as that of the case where a gate line inversion drive(1H inversion drive) is employed to a typical panel. Further, in a casewhere the structure of the second sub-pixel shown in FIG. 103 and FIG.104 is used, it is possible to achieve the same flicker suppressingeffect as that of the case where a dot inversion drive is employed to atypical panel through employing the 2-dot inversion drive by using alayout pattern 6 shown in FIG. 106. FIG. 107 shows the polaritydistribution of the display part when the 2-dot inversion drive isemployed to the layout pattern 6 shown in FIG. 106.

The polarity inversion drive method for the case using the secondsub-pixels shown in FIG. 103 and FIG. 104 is not limited to the 2-dotinversion drive. It is also possible to employ a 3-dot inversion drive(pixel inversion drive) and the like.

Further, the display panel of the exemplary embodiment has beendescribed as the liquid crystal display panel using liquid crystalmolecules. However, as the liquid crystal display panel, not only atransmissive liquid crystal display panel but also a reflective liquidcrystal display panel, a transflective liquid crystal display panel, aslight-reflective liquid crystal display panel in which the ratio of thetransmissive region is larger than that of the reflective region, aslight-transmissive liquid crystal panel in which the ratio of thereflective region is larger than the transmissive region, and the likecan be applied. Further, the driving method of the display panel can beapplied to the TFT method in a preferable manner.

For the TFTs of the TFT method, not only those using amorphous silicon,low-temperature polysilicon, high-temperature polysilicon, singlecrystal silicon, but also those using an organic matter, oxide metalsuch as zinc oxide, and carbon nanotube can also be employed. Further,the present invention does not depend on the structures of the TFTs. Abottom gate type, a top gate type, a stagger type, an inverted staggertype, and the like can also be employed in a preferable manner.

Further, the exemplary embodiment has been described by referring to thecase where the sub-pixel of the up-and-down sub-pixel pairs is in asubstantially trapezoid shape. However, the shape of the sub-pixel isnot limited to the trapezoid, as long as it is a shape which canmaintain the optical property of the up-and-down sub-pixel pairs, andthe connecting relation thereof with respect to the scanning lines andthe data lines. Other polygonal shapes may also be employed. Forexample, when the top side of the trapezoid described in the exemplaryembodiment is shortened, the shape turns out as a triangle. Further,when the upward sub-pixel and the downward sub-pixel are rotationallysymmetric by 180 degrees, a hexagonal shape, an octagonal shape, and thelike with the bent scanning lines may also be employed.

Further, for the display panel, it is possible to employ those otherthan the liquid crystal type. For example, it is possible to employ anorganic electroluminescence display panel, an inorganicelectroluminescence display panel, a plasma display panel, a fieldemission display panel, or PALC (Plasma Address Liquid Crystal).

(Tenth Exemplary Embodiment)

The structure of a display device according to a tenth exemplaryembodiment of the present invention will be described. It is a displaydevice which provides different images to a plurality of N-viewpoints,and it is a feature of this display device that N is 3 or larger while Nis 2 with the display device of the ninth exemplary embodiment.Hereinafter, the tenth exemplary embodiment will be described byreferring to a case of stereoscopic display device which providesdifferent images to four viewpoints (N=4).

First, the outline of the tenth exemplary embodiment will be describedby referring to FIG. 108. A display controller 301 of this exemplaryembodiment further includes an input data rearranging device 360 whichrearranges viewpoint image data for three viewpoints or more inputtedfrom outside into two pieces of image data. Hereinafter, the two piecesof image data rearranged by the input data rearranging device 360 arereferred to as two pieces of input synthesized data.

The writing control device 310 has a function of writing the two piecesof input synthesized data rearranged by the input rearranging device 360to the image memory 320 instead of the viewpoint images inputted fromoutside. The two pieces of input synthesized data correspond to theviewpoint images M1, M2 of the input image data of the ninth exemplaryembodiment. Hereinafter, the tenth exemplary embodiment will bedescribed in details.

The display part of the tenth exemplary embodiment is configured withup-and-down sub-pixel pairs whose structure and equivalent circuits areshown in FIG. 67 and FIG. 68. Explanations of the up-and-down sub-pixelpairs are omitted, since those are the same as the case of the ninthexemplary embodiment.

FIG. 109 is an example showing the relation between an image separatingdevice and the display part according to the tenth exemplary embodiment.Regarding the XY axes in the drawing, X shows the horizontal directionand Y shows the vertical direction. Trapezoids arranged in twelve rowsin the vertical direction and in twelve columns in the horizontaldirection are the sub-pixels, and shadings are the colors in a patternin which R, G, and B are repeated in this order by each row from thefirst row. In the image separating device, a cylindrical lens 230 aconfiguring a lenticular lens 230 corresponds to a unit of four columnsof sub-pixels, and it is so arranged that the longitudinal directionthereof becomes in parallel to the vertical direction so as to exhibitthe lens effect for the horizontal direction. Light rays emitted fromthe sub-pixels are separated to different directions of four-columncycles in a column unit, and form four viewpoint images at positionsdistant from the lens plane due to the lens effect of the cylindricallenses 230 a. The pixel as the structural unit of each of the fourviewpoint images is configured with three sub-pixels of RGB lined in thevertical direction in a column unit. As each example, FIG. 109 shows thepixel of the first viewpoint image as M1P, the pixel of the secondviewpoint image as M2P, the pixel of the third viewpoint image as M3P,and the pixel of the fourth viewpoint image as M4P.

FIG. 110 shows an optical model of each viewpoint image formed by thelight rays emitted from the pixels M1P-M4P for each viewpoint. As shownin FIG. 110, the lenticular lens 230 is disposed on the observer side ofthe display panel, and also disposed in such a manner that the projectedimages from all M1P of the display part are superimposed at a plane awayfrom the lens plane by a distance OD, and also projected images fromM2P, M3P, and M4P are superimposed and the width of the superimposedprojected images in the X direction becomes the maximum. With thislayout, the regions of the first viewpoint image, the second viewpointimage, the third viewpoint image, and the fourth viewpoint image areformed in the horizontal direction in order from the left viewed fromthe observer.

Next, the connecting relation regarding the sub-pixels shown in FIG. 109and scanning line as well as data lines will be described. FIG. 111 isan example of the display part of the tenth exemplary embodiment shownin FIG. 109 which is configured with up-and-down sub-pixel pairs P2R andP2L, and it is a layout pattern 5. As shown in FIG. 111, the combinationof the up-and-down sub-pixel pairs P2L and P2R of the layout pattern 5is the same as that of the layout pattern 3 shown in FIG. 73 from thefirst column to the fourth column of the display part, while theup-and-down sub-pixel pairs P2R and the up-and-down sub-pixel pairs P2Lare switched with respect to the case of the layout pattern 3 from thefifth column to the eight column of the display part. Further, it is thesame with the layout pattern 3 from the ninth column to the twelfthcolumn of the display part. That is, the layout pattern 5 is a patternin which the layout pattern 3 and the pattern where the up-and-downsub-pixels P2R and the up-and-down sub-pixel pairs P2L are switched withrespect to the case of the layout pattern 3 are repeated by every fourcolumns. The layout pattern 5 exhibits a flicker suppressing effect andan effect of suppressing abnormal alignment of the liquid crystalmolecules, when the dot inversion driving method is employed for thepolarity inversion drive method.

FIG. 112 shows the polarity distribution of the display part when thedot inversion drive is applied to the layout pattern 5 shown in FIG.111, and shows the data line polarity for each scanning line of the dotinversion drive. As described in FIG. 109, with the tenth exemplaryembodiment, each viewpoint image is provided in a four-column cycle. Asshown in FIG. 111, the up-and-down sub-pixel pairs P2R and P2L in thelayout pattern 3 (FIG. 73) are switched in a four-column cycle bycorresponding to the periodicity of the viewpoint images, and the dotinversion drive is employed. With this, in each of the separatedviewpoint images from the first viewpoint image to the fourth viewpointimage, the polarities of the laterally-neighboring sub-pixels areinverted, and the polarities are inverted by every two rows of thesub-pixels in the vertical direction. That is, the same flickersuppressing effect as the case of employing the vertical 2-dot inversiondrive for a typical panel can be achieved. Further, regarding thepolarity distribution of the layout pattern 5, the long sides of thepixel electrodes in trapezoids come to be in a same polarity. Thus, itis possible to suppress abnormal alignment of the liquid crystalmolecules in the vicinity of the long sides neighboring to each other,thereby making it possible to provide a high image quality.

Next, described is synthesized image data that is supplied to thedisplay part of the tenth exemplary embodiment by referring to a casewhere the display part is in the layout pattern 5 (FIG. 111). FIG. 113shows image data for four viewpoints inputted to the display controller301 from outside. Each of the first viewpoint image data to the fourthviewpoint image data as the input image data is configured with pixeldata lined in i-rows and j-columns (i=4, j=3). Regarding each ofreference codes in “Mk (Iy, Ix) RGB”, “k” indicates the viewpointnumber, “Iy” is the row number within an image, “Ix” is the columnnumber within the image, and “RGB” means that it carries luminanceinformation of each of the colors R: red, G: green, and B: blue.

FIG. 114 shows synthesized image data 5 to be supplied to the displaymodule, when the input image data shown in FIG. 113 is displayed on thelayout pattern 5 shown in FIG. 111. The synthesized image data 5 can begenerated in the manner described hereinafter by using the input datarearranging device 360 shown in FIG. 108 from the regularities of thedata line unit and the scanning line unit based on the settingparameters of the image separating device and the color layout of thecolor filters, the setting parameter of the layout pattern, and thelayout of the up-and-down sub-pixel layout (LUT) as in the case of theninth exemplary embodiment. FIG. 115 shows LUT (Dy, Gx) which is thepattern of the up-and-down sub-pixel pairs P2R and P2L connected to anarbitrary data line Dy and an arbitrary scanning line Gx of the layoutpattern 5.

The input data rearranging device 360 rearranges the image data forN-viewpoints inputted from outside into two pieces of input synthesizeddata M1′ and M2′ which correspond to the odd-numbered columns and theeven-numbered columns of the display part in a column unit. In thelayout of the image separating device disposed on the display part shownin FIG. 109 and FIG. 110, synthesized input data M1′, M2′ generated fromthe input data for four viewpoints (N=4) shown in FIG. 113 areillustrated in FIG. 116. As show in FIG. 116, rearrangement in a columnunit is executed, so that an arbitrary row number Iy of the input imagedata and the row number of the generated input synthesized datacorrespond with each other (same row number Iy). However, the columnnumber of the input synthesized data is different from the arbitrarycolumn number Ix of the input image data. Thus, the column number of theinput synthesized image data is expressed as Ix′.

In the ninth exemplary embodiment, the two viewpoint images M1 and M2 ofthe input image data are displayed by being separated for theeven-numbered columns and the odd-numbered columns of the display part.Therefore, as described above, it is possible to generate thesynthesized image data with the same processing as the processingdescribed in the ninth exemplary embodiment through sending the inputsynthesized data M1′ and M2′ generated by the rearranging processingthat is executed according to the even-numbered columns and theodd-numbered columns of the display part to the writing control device310. However, in order to generate the input synthesized data by havingthe image data for N-viewpoints inputted from outside corresponded tothe even-numbered columns and the odd-numbered columns of the displaypart, information regarding the column numbers of the display part andthe viewpoint numbers of the inputted image data is required.

FIG. 117 is an example of a relation regarding the column number “x”,the viewpoint images M1-M2 of the input image data, and the inputsynthesized data M1′, M2′ under the relation of the display part and theimage separating device shown in FIG. 109. The column number and theviewpoint image Mk are related to the layout of the image separatingdevice and the number of viewpoints, and determined by design of thedisplay module. For example, the image separating device disposed on theobserver side of the display panel as in FIG. 110 may be disposed to bein the relation with respect to the display part shown in FIG. 118. Inthat case, in order to form the regions of the first viewpoint image,the second viewpoint image, the third viewpoint image, and the fourthviewpoint image along the horizontal direction in order from the leftside viewed from the observer as in the case of FIG. 110, the sub-pixelon the first column (x=1) of the display part corresponds to M2, thesub-pixel of x=2 corresponds to M1, the sub-pixel of x=3 corresponds toM4, the sub-pixel of x=4 corresponds to M3, the sub-pixel of x=5corresponds to M2, - - - , respectively, as shown in FIG. 118.

Further, when the image separating device is disposed to the displaypanel on the opposite side from the observer unlike the case of FIG. 110even though the positional relation between the image separating deviceand the display part is the same as the case of FIG. 117, the sub-pixelof the column number x=1 corresponds to M1, the sub-pixel of x=2corresponds to M2, the sub-pixel of x=3 corresponds to M3, the sub-pixelof x=4 corresponds to M4, - - - , respectively. Further, when the numberof viewpoints of the display module changes, the corresponding relationbetween the column number “x” and the viewpoint number becomes differentfrom that of FIG. 117.

As described above, in order to execute the input rearrangingprocessing, the relation between the column number “x” of the displaypart and the viewpoint number “k” needs to be stored in the displaycontroller. As an example, FIG. 119 shows a table TM (N, op, x) whichshows the value of the viewpoint number “k” according to the columnnumber “x” of the display part. The table TM shown in FIG. 119 usesparameters “N” and “op” for corresponding to a plurality of displaymodules. “N” shows the number of viewpoints, and “op” is correspondeddepending on the difference in the layout of the image separating deviceas in FIG. 117 and FIG. 118. With the table TM, it is not necessary tostore the viewpoint “k” for all the m-columns configuring the displaypart as shown in FIG. 119. It is possible to compress the informationamount by storing the viewpoint according to the repeated pattern of theviewpoint numbers corresponding to the column number. Further, theparameters “N” and “op” may be defined as appropriate according to thedesign of the display controller, and it is possible to compress theinformation amount of the table TM through limiting the types. The tableTM may be stored in the parameter storage device 341 shown in FIG. 108.

The viewpoint number “k” of the input image data corresponding to anarbitrary column “x” of the display part can be obtained from the tableTM. Thus, the input synthesized data M1′ and M2′ can be generatedthrough rearranging the input image data by corresponding those to theeven/odd of the columns of the display part. In the case of FIG. 117,the input synthesized data M1′ is corresponded to the even-numberedcolumns of the display part, and the input synthesized data M2′ iscorresponded to the odd-numbered columns of the display part. However,inversely, the input synthesized data M1′ may be corresponded to theodd-numbered columns of the display part, and the input synthesized dataM2′ may be corresponded to the even-numbered columns of the displaypart. It is to be noted, however, that the corresponding relationbetween the input synthesized data M1′, M2′ and the even/odd of thecolumns of the display part is related to the viewpoint “v1” of theodd-numbered data line and the viewpoint “v2” of the even-numbered dataline used in the readout control device 331. That is, as described byreferring to FIG. 83 of the ninth exemplary embodiment, the values of“v1” and “v2” are determined along with the facing direction “u” of thesub-pixel on the first row of the first column of the display part. FIG.120 summarizes the relation between the input synthesized data M1′, M2′and even/odd of the data lines.

In addition to the table TM, the tenth exemplary embodiment alsorequires the parameter variables shown in FIG. 91 for generating thesynthesized image data as in the case of the ninth exemplary embodiment.The table TM including the viewpoint number (N) and the parameters shownin FIG. 91 are saved in the parameter storage device 341 to be used forgenerating the synthesized image data.

(Explanations of Actions)

An example of the actions of the tenth exemplary embodiment will bedescribed by referring to a flowchart. For the processing that is thesame as the processing of the ninth exemplary embodiment, the samedrawings and reference numerals are used for the explanations. FIG. 121is a flowchart showing the outline of the actions of the tenth exemplaryembodiment.

(Step S21000)

As shown in FIG. 121, when the action of the display device according tothe exemplary embodiment is started, the table TM required forgenerating the input synthesized data and various kinds of parametersrequired for generating the synthesized image are read from theparameter storage device 341 shown in FIG. 108. The viewpoint “v1” showsthe input synthesized data to which the odd-numbered data linecorresponds, and the viewpoint “v2” shows the input synthesized data towhich the even-numbered data line corresponds. Other parameters are thesane as those of the ninth exemplary embodiment, so that explanationsthereof are omitted.

(Step S22000)

The input image data for N-viewpoints configured each with image data ofi-rows and j-columns and the synchronous signals are inputted to theinput data rearranging device 360 shown in FIG. 108 from outside. Theinputted image data for N-viewpoints is rearranged to two pieces ofinput synthesized data M1′ and M2′ which correspond to the odd-numberedcolumns and the even-numbered columns of the display part in a columnunit, and outputted to the writing control device 310. Actions of theinput data rearranging processing will be described separately byreferring to a flowchart shown in FIG. 122.

(Steps S2000, S3000, S8000)

The image input writing processing and the synthesized image outputprocessing is the same as the processing shown in the flowchart of theninth exemplary embodiment where the reference numerals are replacedfrom the viewpoint images M1, M2 of the input image data are replacedwith the input synthesized data M1′, M2′ and the column Ix of the inputimage data is replaced with the column Ix′ of the input synthesizeddata. The ninth exemplary embodiment is to be cited for the flowchartand the explanations of the actions.

Next, actions of the input data rearranging processing will be describedby referring to FIG. 122. The rearranging processing reads out thecorresponding pixel data from the input buffer through counting thecolumn number “x” of the display part, and executing processing by usingthe table TM and by using the count value “x” as the reference. When therearranging processing for one row of the input synthesized data iscompleted, the count value “x” is returned to 1. The same processing isexecuted over i-rows of input image data.

(Step S22100)

The image data for N-viewpoints inputted from outside is stored to theinput buffer by using the synchronous signals inputted from outside.Regarding the data stored in the input buffer, an arbitrary viewpointnumber “k”, position (row Iy, column Ix), and each color (R/G/B)luminance data can be selected in a pixel data unit. The input bufferdoes not depend on the transfer form of the input image data forN-viewpoints, as long as it has the data capacity capable of storing allthe inputted image data for N-viewpoints. In other words, the datacapacity of the input buffer can be compressed according to thecharacteristics of the form (e.g., side-by-side format) with which theinput image data for N-viewpoints is inputted.

(Step S22200)

“1” is given to the variables “x”, “Iy”, “Ix′”, “Nk” and “Nq” as aninitial value. Further, “x” shows the column number of the display part.“Iy” shows the row number of the input image data and the row number ofthe input synthesized data, and “Ix′” shows the column number of theinput synthesized data to be generated. “Nk” is the count value whencounting the viewpoints number from 1 to N, and “Nq” is the variableused for designating the column number of the input pixel data.

(Step S22300)

Even/odd of the count value “x” of the column is judged. The judgmentcondition is whether “x” is an odd-number or an even number. When judgedas Yes, the procedure is advanced to step S22400. When judged as No, theprocedure is advanced to step S22500.

(Step S22400)

The pixel data “M{TM(N, op, x)} (Iy, Nq) RGB” is read out from the inputbuffer by using the table TM and the count value “x”, “Iy”, and “Nq”,and it is substituted to the input synthesized data “M2′(Iy, Ix′) RGB”.Note here that the substitution processing to the input synthesized datais executed assuming the case where the input synthesized data M2′ iscorresponded to the odd-numbered columns of the display part. When theinput synthesized data M1′ is corresponded to the odd-numbered columnsof the display part, the input synthesized image data M2′ in this stepmay be replaced with the input synthesized data M1′.

(Step S22500)

The pixel data “M{TM(N, op, x)} (Iy, Nq) RGB” is read out from the inputbuffer by using the table TM and the count value “x”, “Iy”, and “Nq”,and it is substituted to the input synthesized data “M1′(Iy, Ix′) RGB”.Note here that the substitution processing to the input synthesized datais executed assuming the case where the input synthesized data M1′ iscorresponded to the even-numbered columns of the display part. When theinput synthesized data M2′ is corresponded to the even-numbered columnsof the display part, the input synthesized image data M1′ in this stepmay be replaced with the input synthesized data M2′.

(Step S22600)

“1” is added to the count value “Ix′” which shows the column number ofthe input synthesized data.

(Step S23000)

It is judged whether the count value “Nk” showing the viewpoint numberhas reached to “N”. The judgment is conducted by comparing the number ofviewpoints (types) “N” of the input image data read as TM in step S21000shown in FIG. 121 with the count value “Nk”. When the count value “Nk”has not reached to the viewpoint number “N”, it is judged as Yes and theprocedure is advanced to step S23100. When the count value “Nk” hasreached to the viewpoint number “N”, it is judged as No and theprocedure is advanced to step S23200.

(Step S23100)

“1” is added to the count value “Nk”, and the procedure is advanced tostep S23400.

(Step S23200)

The count value “Nk” is returned to 1, and 1 is added to the count value“Nq” which designates the column number of the input pixel data.

(Step S23300)

It is judged whether the count value “x” of the column of the displaypart has reached to the column number “m” of one row. The judgment isconducted by comparing the count value “x” with the column number “m” ofthe display part read in step S21000 shown in FIG. 121. When the countvalue “x” has not reached to the column number “m”, it is judged as Yesand the procedure is advanced to step S23400. When the count value “x”has reached to the column number “m”, it is judged as No and theprocedure is advanced to step S24000.

(Step S23400)

“1” is added to the count value “x”, and the procedure is advanced tostep S22300.

(Step S24000)

The rearranging processing for one row has been completed, so that thecount values “x”, “Ix′”, and “Nq” are returned to 1.

(Step S24100)

It is judged whether the count value “Iy” has reached to row number“n/3” of the input image data calculated from the row number “n” of thesub-pixel of the display part read in step S21000 shown in FIG. 121. Thejudgment is conducted by comparing the count number “Iy” with “n/3”.When the count value “Iy” has not reached to “n/3”, it is judged as Yesand the procedure is advanced to step S24200. When the count value “Iy”has reached to “n/3”, it is judged as No and the procedure is advancedto step S24300.

(Step S24200)

“1” is added to the count value “Iy”, and the procedure is advanced tostep S22300.

(Step S24300)

The input synthesized data M1′ and M2′ rearranged by the above-describedsteps are outputted to the writing control device 310 shown in FIG. 108.With this step, the input data rearranging processing is completed, andthe procedure is advanced to step S2000 shown in FIG. 121.

While the actions of the tenth exemplary embodiment have been describedabove, the explanations provided above are merely presented as a way ofexamples, and the exemplary embodiment is not limited only to that. Forexample, in the input data rearranging processing shown in FIG. 122, thecount value “x” of the column of the display part is used as thereference to execute the processing, and the input pixel data isalternately substituted to M2′ and M1′. However, it is possible tochange the flow to execute substitution processing of the input pixeldata to M1′ after completing all the substitution processing for M2′.

Further, regarding the structure of the tenth exemplary embodiment, FIG.10 separately illustrates the input data rearranging device 360 and thewriting control device 310. However, the structure of the exemplaryembodiment is not limited only to such case. For example, the writingcontrol device 310 may include the input data rearranging function shownin FIG. 116. By having the writing control device 310 control thegenerated addresses in a column unit of each viewpoint image, the sameprocessing as the input data rearranging processing shown in FIG. 116can be executed.

(Effects)

As shown in FIG. 110, the number of viewpoints can be increased with thetenth exemplary embodiment. Thus, the observer can enjoy stereoscopicimages from different angles by changing the observing positions.Further, motion parallax is also provided at the same time, which cangive a higher stereoscopic effect to the images.

(Eleventh Exemplary Embodiment)

The structure of a display device according to an eleventh exemplaryembodiment of the present invention will be described. The eleventhexemplary embodiment is the same as the display device of the ninthexemplary embodiment, except that the region of the image memoryprovided to the display controller is reduced.

FIG. 123 shows a functional block diagram of the eleventh exemplaryembodiment. As in the case of the ninth exemplary embodiment, it isconfigured with: a display controller 302 which generates synthesizedimage data CM from the image data for each viewpoint inputted fromoutside; and a display panel 220 which is a display device of thesynthesized image data CM. The display panel 220 includes a display part250 as in the case of the ninth exemplary embodiment. In the displaypart 250, data lines are so arranged that the extending directionthereof is set to be the horizontal direction (X direction), andscanning lines are so arranged that the extending direction thereof isset to be the vertical direction (Y direction).

The structure of the display controller 302 is different from that ofthe ninth exemplary embodiment in respect that the region of the imagememory is reduced and that a line memory 322 is provided. The linememory 322 has a memory region for a plurality of columns of sub-pixels240 of the display part 250. The display controller 302 includes: awriting control device 312 which has a function of writing input imagedata to the line memory 322; and a readout control device 332 which hasa function of reading out the data from the line memory 322. Otherstructures of the display controller 302 are the same as those of theninth exemplary embodiment, so that the same reference numerals areapplied thereto and explanations thereof are omitted.

The eleventh exemplary embodiment uses the input image data transferform shown in FIG. 124C. With this, the image memory capable of writingand saving all the input image data becomes unnecessary, thereby makingit possible to reduce the memory region. The transfer form of the inputimage data according to the eleventh exemplary embodiment will bedescribed by referring to FIG. 124.

FIG. 124A shows viewpoint images M1 and M2 as the images for the lefteye and the right eye. Each of the viewpoint images M1 and M2 isconfigured with pixel data of i-rows and j-columns, and the pixel datacarries three-color luminance information of R(red) luminance, G(green)luminance, and B(blue) luminance. FIG. 124B shows a stereoscopic imageobserved from a proper observing position, when the viewpoint images M1and M2 shown in FIG. 124A are displayed on the display part 250. FIG.124C is a transfer image of the viewpoint images M1 and M2 shown in FIG.124A of the eleventh exemplary embodiment.

As shown in FIG. 70, with the image separating device (lenticular lens230), the sub-pixels on the odd-numbered columns of the display part 250are M2 (for the right eye) and the sub-pixels on the even-numberedcolumns are M1 (for the left eye). In the eleventh exemplary embodiment,the viewpoint image data shown in FIG. 124A is transferred by eachcolumn for enabling the processing by the line memory 322. Further, thetransfer order of the viewpoint images M1 and M2 is corresponded to thestart column of the display part 250. Thus, in the case of the layout ofthe image separating device shown in FIG. 70, the data transfer isstarted from “M2 (1, 1) RGB”. Subsequently, the data transfer isexecuted as in “M2 (2, 1) RGB”, “M2 (3, 1) RGB”, - - - . When it reachesto “M2 (i, 1) RGB”, the transfer then starts in order of “M1 (1, 1)RGB”, “M1 (2, 1) RGB”, “M1 (3, 1) RGB”, - - - , “M1 (i, 1) RGB”. Whenthe data transfer of M2 and M1 on the first column is completed, thetransfer is repeated in the same manner on the second column, the thirdcolumn, - - - , until completing the data transfer of the j-th column.

Next, the transfer method described by referring to FIG. 124 and theactions of the eleventh exemplary embodiment using the line memory willbe described by referring to FIG. 125. FIG. 125 shows output timings ina scanning line unit when the image data of viewpoint images M1, M2configured with 4 rows×6 columns of pixels shown in FIG. 69 are inputtedaccording to the above-described transfer method. “T” shows one scanningperiod of the display panel, and input data shows transfer of theviewpoint images M1 and M2 shown in FIG. 69 in a column unit. From L1 toL3 are line memories which can store each of inputted viewpoint imagedata for one column.

The data of M2 on the first column is stored in L1 in a period of T=1(abbreviated as T1 hereinafter). Subsequently, in T2, the line dataoutput processing (FIG. 94-FIG. 101) described in the ninth exemplaryembodiment is executed by using the data stored in L1, and thesynthesized image data of scanning line G1 is outputted. Further, in T2,the data of M1 on the first column is stored to L2 in parallel. Then, inT3, the line data output processing (FIG. 94-FIG. 101) described in theninth exemplary embodiment is executed by using the data stored in L1and L2, and the synthesized image data of scanning line G2 is outputted.Further, in T3, the data of M2 on the second column is stored to L3 inparallel. Then, in T4, the line data output processing as in T2 and T3is executed by using the data stored in L2 and L3, and the synthesizedimage data of scanning line G3 is outputted. Here, output of the data ofM2 on the first column stored in L1 is completed in T2 and T3. Thus, inT4, the data of M1 on the second column is stored in L1. In next periodT5, the line data output processing is executed by using the data storedin L3 and L1, and the synthesized data of scanning line G5 is outputted.Through repeating the processing described above, the synthesized dataup to the scanning line G13 is outputted as shown in FIG. 125.

Therefore, the memory region for the image data required in the eleventhexemplary embodiment is three columns of each viewpoint image data. Withthe sub-pixel unit of the display part, it is necessary to have a datastorage region for the number of sub-pixels (except for G1 and Gm+1)which are connected to three scanning lines. That is, in a case whendisplaying the two pieces of input viewpoint image data of 4 rows×6columns shown in FIG. 125, it is required to have a data region ofthirty-six sub-pixels (4×3 (color)×3 (scanning line)=36). In a casewhere the display part is configured with sub-pixels of n-rows andm-columns, it is required to have a data region of “n×3” sub-pixels.

In the above, the eleventh exemplary embodiment has been described byreferring to the case where the image separating device is so arrangedthat the sub-pixels on the odd-numbered columns of the display part 250are M2 (for the right eye) and the sub-pixels on the even-numberedcolumns are M1 (for the left eye), as show in FIG. 70. However, theexemplary embodiment can be applied even when the image separatingdevice is so arranged that the sub-pixels on the odd-numbered columns ofthe display part 250 are M1 (for the left eye) and the sub-pixels on theeven-numbered columns are M2 (for the right eye), as show in FIG. 82.However, in the case where the image separating device is arranged as inFIG. 82, it is necessary to change the transfer order of the viewpointimages M1, M2 and to execute data transfer from the first column of M1.

Further, in order to reduce the region of the image memory, the eleventhexemplary embodiment uses the transfer form of the input image datashown in FIG. 124. However, the transfer form of the input image data isnot limited only to that. For example, a transfer form shown in FIG. 126may be used. The transfer form shown in FIG. 126 is a method whichtransfers the viewpoint images M1 and M2 alternately in a pixel dataunit. However, in the case of the transfer method shown in FIG. 126, itis necessary to increase the memory capacity compared to the case of thetransfer form shown in FIG. 124.

Furthermore, while the eleventh exemplary embodiment has been describedby referring to the display device of N=2 as in the case of the ninthexemplary embodiment, it is also possible to apply the eleventhexemplary embodiment to the display device of the tenth exemplaryembodiment having three or more viewpoints (N=3 or larger). In the casewhere N is 3 or more, the viewpoint image may be transferred by eachcolumn in accordance with the corresponding order of the viewpointimages on the display part determined due to the layout of the imageseparating device.

(Effects)

With the eleventh exemplary embodiment, the image memory can be reduceddown to the line memory which corresponds to the sub-pixel data forthree scanning lines. Thus, the circuit scale of the display controllercan be reduced greatly, thereby making it possible to cut the cost.Furthermore, the size can be reduced as well. For example, the number ofalternatives regarding the places to have the display controller loadedcan be increased, e.g., the display controller can be built-in to thedata-line driving circuit.

(Twelfth Exemplary Embodiment)

The structure of a display device according to a twelfth exemplaryembodiment of the present invention will be described. The structure ofthe twelfth exemplary embodiment is the same as that of the eleventhexemplary embodiment shown in FIG. 123 of the eleventh exemplaryembodiment which uses the line memory. However, the transfer method ofthe input image data, rearranging processing of the image data, and thedriving method of the display panel are different with respect to thoseof the eleventh exemplary embodiment.

The transfer form of the input image data used in the twelfth exemplaryembodiment will be described by referring to FIG. 127. As in the case ofFIG. 124A, FIG. 127A shows viewpoint images M1 and M2 each configuredwith pixel data of i-rows and j-columns, and the pixel data carriesthree-color luminance information. As in the case of FIG. 124B, FIG.127B shows a stereoscopic image. FIG. 127C is a transfer images of theviewpoint images M1 and M2 shown in FIG. 127A.

As shown in FIG. 127C, the transfer form of the input image dataaccording to the twelfth exemplary embodiment is a method whichtransfers data by a viewpoint image unit, which is the so-called a frametime-division transfer form. FIG. 127C shows a case where the pixel dataof the viewpoint image M1 is transferred following the transfer of theviewpoint image M2. As described in the eleventh exemplary embodiment,the viewpoint image data is transferred by each column also in thetwelfth exemplary embodiment for enabling the processing by the linememory. As shown in FIG. 127C, when the data transfer is started from“M2 (1, 1) RGB”, the data transfer is then executed as in “M2 (2, 1)RGB”, “M2 (3, 1) RGB”, - - - . When it reaches to “M2 (i, 1) RGB”, thedata is transferred in order of “M2 (1, 2) RGB”, “M2 (2, 2) RGB”, “M2(3, 2) RGB”, - - - , “M2 (i, 2) RGB”. When the transfer is repeated inthe same manner and the data transfer of viewpoint image on the j-thcolumn, M2 (i, j) RGB, is completed, the data transfer of the viewpointimage M1 is started from “M1 (1, 1) RGB”. Then, the data transfer on thefirst column is executed as in “M1 (2, 1) RGB”, “M1 (3, 1) RGB”, - - -“M1 (i, 1) RGB”. In the same manner, data transfer is executed on thesecond column, the third column, - - - . Thereby, the data transfer ofthe viewpoint image M1 up to the j-th column, “M1 (i, j) RGB”, iscompleted.

Next, the image data rearranging processing and driving method accordingto the twelfth exemplary embodiment will be described by referring toFIG. 128. As an example of the actions of the twelfth exemplaryembodiment, used is a case where the image separating device (230) isdisposed to the display part (FIG. 123) as in the case of FIG. 70, andthe display panel 220 win the layout pattern of FIG. 71 is driven. FIG.128 shows timings for outputting synthesized image data to the displaypanel in a scanning line unit when the image data of viewpoint imagesM1, M2 configured with 4 rows×6 columns of pixels shown in FIG. 69 isinputted according to the above-described transfer method (FIG. 127C).“T” in FIG. 128 shows one scanning period of the display panel, andinput data shows transfer of the viewpoint images M1 and M2 shown inFIG. 69 in a column unit. L1 and L2 are line memories which can storeeach of inputted viewpoint image data for one column.

The twelfth exemplary embodiment does not use the image memory to whichall the input image data can be written and saved. Thus, as shown inFIG. 128, all the scanning lines of the display panel are scanned inevery transfer period of input image data for one viewpoint. At the timeof scanning, among the sub-pixels connected to the selected scanningline, data is read out from the line memory for the viewpoint sub-pixelwhose data is stored in the line memory. For the viewpoint sub-pixelswhose data is not stored in the line memory, data with which theviewpoint image display thereof becomes black display (minimum luminancedisplay) is outputted. “Black” in FIG. 128 shows the data which providesblack display.

FIG. 128 will be described in detail. The data of M2 on the first columnis stored in L1 in a period of T=1 and a period of T=2 (abbreviated asT1 and T2 hereinafter). Subsequently, in T3 and T4, the line data outputprocessing (FIG. 94-FIG. 101) described in the ninth exemplaryembodiment is executed by using the data stored in L1. At this time, if“k” takes a value designating M1 in step S5720 shown in FIG. 95, theblack data mentioned earlier is supplied to PD. Further, in T3 and T4,the data of M2 on the second column is stored to L2 in parallel with theoutput action of the synthesized image data of the scanning lines G1 andG2. Then, in T5 and T6, the synthesized image data of the scanning linesG3 and G4 are outputted through the same processing described above byusing the data stored in L2. Further, the readout action of the data ofM2 on the first column stored in L1 is completed in T4, so that the dataof M2 on the third column is stored to L1 in T5 and T6. Thereafter, thesame processing described above is repeated, and output of thesynthesized image data up to the scanning line G13 is completed in T15.The input data from T13 to T15 is shown with oblique lines as invaliddata, which is the so-called blacking period. Then, the data of M1 onthe first column is stored to L1 in a period of T16 and T17. Further,the line data output processing (FIG. 94-FIG. 101) for the scanning lineG1 is started from T17. At this time, as described earlier, if “k” takesa value designating M2 in step S5720 shown in FIG. 95, the black datamentioned earlier is supplied to PD. Subsequently, in T18 and T19,synthesized image data of the scanning lines G2 and G3 are outputted byusing the data stored in L1. Further, the data of M1 on the secondcolumn is stored to L2 in parallel to this output action. Thereafter,the same processing described above is repeated, and output of thesynthesized image data up to the scanning line G13 is completed in T29.

In the twelfth exemplary embodiment operated in the manner describedabove, the required memory region for the image data is the capacity ofthe line memories L1, L2 of FIG. 128, i.e., for two columns of inputtedviewpoint image data. FIG. 129 shows the corresponding relation betweenthe first column, the second column of the second viewpoint image dataM2 shown in FIG. 69 and the sub-pixels of the display panel with thelayout pattern shown in FIG. 71. From FIG. 129, the memory region forthe image data required in the twelfth exemplary embodiment can beexpressed as the number of the sub-pixels that are connected to twoscanning lines (except for G1 and Gm+1). In other words, the requiredmemory region is “n×2” sub-pixels when the display part is configuredwith sub-pixels of n-rows and m-columns.

In the above, the twelfth exemplary embodiment has been described byreferring to the case where the image separating device is so arrangedthat the sub-pixels on the odd-numbered columns of the display part 250(FIG. 123) are M2 (for the right eye) and the sub-pixels on theeven-numbered columns are M1 (for the left eye), as shown in FIG. 70.However, the exemplary embodiment can be applied even when the imageseparating device is so arranged that the sub-pixels on the odd-numberedcolumns of the display part 250 (FIG. 123) are M1 (for the left eye) andthe sub-pixels on the even-numbered columns are M2 (for the right eye),as shown in FIG. 82. Further, while the twelfth exemplary embodiment hasbeen described by referring to the case of the display part that isformed in the layout pattern of FIG. 71, the exemplary embodiment is notlimited only to that. As described in the ninth exemplary embodiment,the twelfth exemplary embodiment can be applied to various layoutpatterns based on the regularity of the sub-pixel layout and settings ofthe parameters.

(Effects)

With the twelfth exemplary embodiment, the image memory can be reduceddown to the line memory which corresponds to the sub-pixel data for twoscanning lines. Thus, the circuit scale of the display controller can bereduced greatly, thereby making it possible to cut the cost.Furthermore, the size can be reduced as well. For example, the number ofalternatives regarding the places to have the display controller loadedcan be increased, e.g., the display controller can be built-in to thedata-line driving circuit.

(Thirteenth Exemplary Embodiment)

The structure of a display device according to a thirteenth exemplaryembodiment of the present invention will be described. The thirteenthexemplary embodiment uses the same input image data transfer form (theso-called frame time-division transfer form) as that of the twelfthexemplary embodiment, and uses the line memory corresponding to thesub-pixel data for two scanning lines as the image memory as in the caseof the twelfth exemplary embodiment. The structure of the data-linedriving circuit for driving the data lines is different with respect tothe twelfth exemplary embodiment. The data-line driving circuit used inthe thirteenth exemplary embodiment alternately drives the odd-numbereddata lines and the even-numbered data lines on the display part to be ina high-impedance state.

The structure of the thirteenth exemplary embodiment will be describedby referring to FIG. 130. FIG. 130 shows a display panel 20 (FIG. 123)which uses a data-line driving circuit 285 which is different from thatof the twelfth exemplary embodiment. Explanations of the structuralcomponents that are the same as those of the third and twelfth exemplaryembodiments shown in FIG. 124 are omitted by applying the same referencenumerals thereto. An example of the data-line driving circuit used inthe thirteenth exemplary embodiment shown in FIG. 130 is structured byadding an selection circuit 287 on the output side of the data-linedriving circuit 280 (simply referred to as “circuit 280” hereinafter)used in other exemplary embodiments. The selection circuit 287 includesa switch function which changes over connection/disconnection forodd-numbered outputs and even-numbered outputs in accordance with asignal SEL 288. FIG. 130 shows a state where the odd-numbered outputsare connected and the even-numbered outputs are disconnected. The datalines disconnected from the outputs of the circuit 280 by the selectioncircuit 287 come under a high-impedance state.

Next, actions of the thirteenth exemplary embodiment will be describedby referring to FIG. 131. FIG. 131 shows a timing chart for outputtingthe synthesized image data to the display panel in a scanning line unitwhen the image data of viewpoint images M1, M2 configured with 4 rows×6columns of pixels shown in FIG. 69 are inputted according to thetransfer method of FIG. 127C, as in FIG. 128 used for the twelfthexemplary embodiment. The display part 250 is formed with the layoutpattern show in FIG. 71, and it is assumed that the image separatingdevice is disposed as in FIG. 70.

“T”, the input data, the line memories L1, L2, and the outputs in FIG.131 are the same as those of FIG. 128 described in the twelfth exemplaryembodiment, so that explanations thereof are omitted by applying thesame reference numerals thereto. SEL in FIG. 131 is a signal whichcontrols the selection circuit 287 shown in FIG. 130. When SEL=H, theoutputs of the circuit 280 and the even-numbered data lines areconnected, and the even-numbered data lines come to be in ahigh-impedance state. When SEL=L, the relation of the odd-numbered datalines and the even-numbered data lines is switched over.

When SEL becomes H in T2, the odd-numbered data lines come to be in ahigh-impedance sate. Then, in T3 and T4, the synthesized image data ofthe scanning lines G1 and G2 is outputted from the input data of M2(first column) stored in the line memory L1. In this period, there is noinput image data of M1 for generating the synthesized image data.However, in this example of the actions, the M1-viewpoint sub-pixels areconnected to the odd-numbered data lines. In the sub-pixels connected tothe odd-numbered data lines that are in the high-impedance state due tothe state of SEL=H, writing of data is not executed even if the scanningline is selected. Thus, PD when “k” designates M1 is invalid whengenerating the synthesized image data, and black data may be supplied asin the case of the twelfth exemplary embodiment, for example. That is,the processing actions executed in the period from T2 to T6 are the sameas the actions of the twelfth exemplary embodiment. Thus, explanationsthereof are omitted.

When SEL becomes L in T16, the even-numbered data lines come to be in ahigh-impedance state. In this example of the actions, the M2-viewpointsub-pixels are connected to the even-numbered data lines. In thesub-pixels connected to the high-impedance data lines, writing of datais not executed even if the scanning line is selected. Thus, the statewhere the data is written in the period from T3 to T14 is kept. Further,as described earlier, the processing actions regarding generation of thesynthesized image data are the same as the actions of the twelfthexemplary embodiment. Thus, explanations thereof are omitted.

As described above, with the thirteenth exemplary embodiment, thehigh-impedance state of the even/odd-numbered data lines is repeated byevery scanning period of all the scanning lines by corresponding to theviewpoint of the input image data. With this, data writing and keepingof the written state are repeated for every scanning period of all thescanning lines in a unit of each viewpoint sub-pixel. The requiredmemory region for the image data is the capacity for the line memoriesL1, L2, i.e., for two columns of inputted viewpoint image data, as inthe case of the twelfth exemplary embodiment. It can be expressed as thenumber of the sub-pixels that are connected to two scanning lines(except for G1 and Gm+1).

In the above, the data-line driving circuit configuring the thirteenthexemplary embodiment has been described by referring to FIG. 130.However, the thirteenth exemplary embodiment is not limited only to suchcase, as long as it has a function which can alternately drive theodd-numbered data lines and the even-numbered data lines on the displaypart to be in a high-impedance state. For example, it is possible toemploy the structure of a data-line driving circuit shown in FIG. 132.FIG. 132 shows a case where the structure of the selection circuit 287is changed into the structure of a selection circuit 289. In this case,the number of outputs of the circuit 280 shown in FIG. 130 can bereduced to a half as in the circuit 286 shown in FIG. 132, so that thecircuit scale can be reduced. Furthermore, it is also possible to employthe structure of a data-line driving circuit shown in FIG. 132, in whichthe structures of FIG. 130 and FIG. 132 are combined.

Further, while the thirteenth exemplary embodiment has been described byreferring to the example shown in FIG. 130 which is configured withsub-pixels of 12 rows×12 columns, the display part is not limited onlyto such case. The display part is configured with sub-pixels of n-rowsand m-columns. Further, while the thirteenth exemplary embodiment hasbeen described by referring to the case where the image separatingdevice is disposed to the display part as shown in FIG. 70, the imageseparating device may be disposed in the manner as shown in FIG. 82.Further, while the thirteenth exemplary embodiment has been described byreferring to the case of the display part that is formed in the layoutpattern of FIG. 71, the exemplary embodiment is not limited only tothat. As described in the ninth exemplary embodiment, the thirteenthexemplary embodiment can be applied to various layout patterns based onthe regularity of the sub-pixel layout and settings of the parameters.

(Effects)

With the thirteenth exemplary embodiment, the effect of reducing theimage memory down to the line memory can be achieved as in the case ofthe twelfth exemplary embodiment. In addition, it is possible to providea brighter display screen compared to the case of the twelfth exemplaryembodiment, since the thirteenth exemplary embodiment does not provideblack display.

While the present invention has been described above by referring toeach of the exemplary embodiments, the present invention is not limitedto each of those exemplary embodiments described above. Various changesand modifications that occurred to those skilled in art can be appliedto the structures and details of the present invention. It is to beunderstood that the present invention includes forms that are mutual andproper combinations of a part of or a whole part of the structures ofeach of the exemplary embodiments.

Industrial Applicability

The present invention can be applied to portable telephones, portablegame machines, portable terminals, other general display devices(personal notebook computers, etc.), and the like.

What is claimed is:
 1. A display controller for outputting synthesizedimage data to a display module which includes: a display part in whichsub-pixels connected to data lines via switching devices controlled byscanning lines are arranged in m-rows and n-columns (m and n are naturalnumbers), which is driven by (m+1) pieces of the scanning lines and atleast n pieces of the data lines; and a first image separating devicewhich directs light emitted from the sub-pixels towards a plurality ofviewpoints in a sub-pixel unit; the display controller comprising: animage memory which stores viewpoint image data for the plurality ofviewpoints; a writing control device which writes the viewpoint imagedata inputted from outside to the image memory; a parameter storagedevice which stores parameters showing a positional relation between thefirst image separating device and the display part; and a readoutcontrol device which reads out the viewpoint image data from the imagememory according to a readout order that is obtained by applying theparameters to a repeating regulation that is determined based on layoutof the sub-pixels, number of colors, and layout of the colors, andoutputs the readout data to the display module as the synthesized imagedata, wherein: the display part is formed by having an up-and-downsub-pixel pair that is formed with two of the sub-pixels arranged bysandwiching one scanning line as a basic unit; the switching devicesprovided respectively to the two sub-pixels are controlled in common bythe scanning line sandwiched by the two sub-pixels and are connected todifferent data lines from each other; the up-and-down sub-pixel pairsneighboring to each other in an extending direction of the scanninglines are so disposed that the switching devices thereof are controlledby the different scanning lines from each other; the number of colors ofthe sub-pixels are three colors of a first color, a second color, and athird color; provided that “y” is a natural number, one of the colors oftwo sub-pixels of the up-and-down sub-pixel pair connected to y-thscanning line is the first color and the other color is the secondcolor, the pair forming either an even-numbered column or anodd-numbered column of the display part; one of the colors of twosub-pixels of the up-and-down sub-pixel pair connected to (y+1)-thscanning line is the second color and the other color is the thirdcolor, the pair forming the other one of the even-numbered column or theodd-numbered column of the display part; one of the colors of twosub-pixels of the up-and-down sub-pixel pair connected to (y+2)-thscanning line is the third color and the other color is the first color,the pair forming either an even-numbered column or an odd-numberedcolumn of the display part; one of the colors of two sub-pixels of theup-and-down sub-pixel pair connected to (y+3)-th scanning line is thefirst color and the other color is the second color, the pair formingthe other one of the even-numbered column or the odd-numbered column ofthe display part; one of the colors of two sub-pixels of the up-and-downsub-pixel pair connected to (y+4)-th scanning line is the second colorand the other color is the third color, the pair forming either aneven-numbered column or an odd-numbered column of the display part; oneof the colors of two sub-pixels of the up-and-down sub-pixel pairconnected to (y+5)-th scanning line is the third color and the othercolor is the first color, the pair forming the other one of theeven-numbered column or the odd-numbered column of the display part; andaccording to a following readout order from the image memory, thereadout control device: reads out the first color and the second colorby corresponding to the y-th scanning line, and reads out a viewpointimage which corresponds to one of the even-numbered column or theodd-numbered column of the display part; reads out the second color andthe third color by corresponding to the (y+1)-th scanning line, andreads out a viewpoint image which corresponds to the other one of theeven-numbered column or the odd-numbered column of the display part;reads out the third color and the first color by corresponding to the(y+2)-th scanning line, and reads out a viewpoint image whichcorresponds to one of the even-numbered column or the odd-numberedcolumn of the display part; reads out the first color and the secondcolor by corresponding to the (y+3)-th scanning line, and reads out aviewpoint image which corresponds to the other one of the even-numberedcolumn or the odd-numbered column of the display part; reads out thesecond color and the third color by corresponding to the (y+4)-thscanning line, and reads out a viewpoint image which corresponds to oneof the even-numbered column or the odd-numbered column of the displaypart; reads out the third color and the first color by corresponding tothe (y+5)-th scanning line, and reads out a viewpoint image whichcorresponds to the other one of the even-numbered column or theodd-numbered column of the display part.
 2. The display controller asclaimed in claim 1, wherein the image memory includes a memory region atleast for the sub-pixels of 6 rows×n-columns.
 3. A display controller asclaimed in claim 1, wherein the image memory includes a memory region atleast for the sub-pixels of 9 rows×(n/2) columns.
 4. The displaycontroller as claimed in claim 1, comprising a function which separatelyand sequentially scans the scanning lines of the sub-pixels which formthe even-numbered columns of the display part and the scanning lines ofthe sub-pixels which form the odd-numbered columns of the display part.5. The display controller as claimed in claim 1, comprising a functionwhich drives either the even-numbered columns or the odd-numberedcolumns of the display part to be in black display.
 6. The displaycontroller as claimed in claim 1, wherein a transfer form of theviewpoint image data is a frame sequential form.
 7. A display device,comprising the display controller and the display module claimed inclaim
 1. 8. An image processing method for generating synthesized imagedata to be outputted to a display module which includes: a display partin which sub-pixels connected to data lines via switching devicescontrolled by scanning lines are arranged in m-rows and n-columns (m andn are natural numbers), which is driven by (m+1) pieces of the scanninglines and at leas pieces of the data lines; and a first image separatingdevice which directs light emitted from the sub-pixels towards aplurality of viewpoints in a sub-pixel unit; the method comprising:reading parameters showing a positional relation between the first imageseparating device and the display part from a parameter storage device;inputting viewpoint image data for a plurality of viewpoints fromoutside, and writing the data into the image memory; and reading out theviewpoint image data from the image memory according to a readout orderthat is obtained by applying the parameters to a repeating regulationthat is determined based on la rout of the sub-pixels, number of colors,and layout of the colors, and outputting the readout data to the displaymodule as the synthesized image data, wherein: the display part isformed by having an up-and-down sub-pixel pair that is formed with twoof the sub-pixels arranged by sandwiching one scanning line as a basicunit; the switching devices provided respectively to the two sub-pixelsare controlled in common by the scanning line sandwiched by the twosub-pixels, and are connected to different data lines from each other;the up-and-down sub-pixel pairs neighboring to each other in anextending direction of the scanning lines are so disposed that theswitching devices thereof are controlled by the different scanning linesfrom each other; the number of colors of the sub-pixels are three colorsof a first color, a second color, and a third color; provided that “y”is a natural number, one of the colors of two sub-pixels of theup-and-down sub-pixel pair connected to y-th scanning line is the firstcolor and the other color is the second color, the pair forming eitheran even-numbered column or an odd-numbered column of the display part;one of the colors of two sub-pixels of the up-and-down sub-pixel pairconnected to (y+1)-th scanning line is the second color and the othercolor is the third color, the pair forming the other one of theeven-numbered column or the odd-numbered column of the display part; oneof the colors of two sub-pixels of the up-and-down sub-pixel pairconnected to (y+2)-th scanning line is the third color and the othercolor is the first color, the pair forming either an even-numberedcolumn or an odd-numbered column of the display part; one of the colorsof two sub-pixels of the up-and-down sub-pixel pair connected to(y+3)-th scanning line is the first color and the other color is thesecond color, the pair forming the other one of the even-numbered columnor the odd-numbered column of the display part; one of the colors of twosub-pixels of the up-and-down sub-pixel pair connected to (y+4)-thscanning line is the second color and the other color is the thirdcolor, the pair forming either an even-numbered column or anodd-numbered column of the display part; one of the colors of twosub-pixels of the up-and-down sub-pixel pair connected to (y+5)-thscanning line is the third color and the other color is the first color,the pair forming the other one of the even-numbered column or theodd-numbered column of the display part, the image processing methodcomprises reading out the viewpoint image data from the image memoryaccording to a readout order that is obtained by applying the parametersto a repeating regulation that is determined based on layout of thesub-pixels, number of colors, and layout of the colors, and outputtingthe readout data to the display module as the synthesized image data,from the image memory, according to a following readout order of:reading out the first color and the second color by corresponding to they-th scanning line, and reading out a viewpoint image which correspondsto one of the even-numbered column or the odd-numbered column of thedisplay part; reading out the second color and the third color bycorresponding to the (y+1)-th scanning line, and reading out a viewpointimage which corresponds to the other one of the even-numbered column orthe odd-numbered column of the display part; reading out the third colorand the first color by corresponding to the (y+2)-th scanning line, andreading out a viewpoint image which corresponds to one of theeven-numbered column or the odd-numbered column of the display part;reading out the first color and the second color by corresponding to the(y+3)-th scanning line, and reading out a viewpoint image whichcorresponds to the other one of the even-numbered column or theodd-numbered column of the display part; reading out the second colorand the third color by corresponding to the (y+4)-th scanning line, andreading out a viewpoint image which corresponds to one of theeven-numbered column or the odd-numbered column of the display part; andreading out the third color and the first color by corresponding to the(y+5)-th scanning line, and reading out a viewpoint image whichcorresponds to the other one of the even-numbered column or theodd-numbered column of the display part.
 9. The image processing methodas claimed in claim 8, comprising: separately and sequentially scanningthe scanning lines of the sub-pixels which form the even-numberedcolumns of the display part and the scanning lines of the sub-pixelswhich form the odd-numbered columns of the display part.
 10. The imageprocessing method as claimed in claim 8, comprising: generating datawith which either the even-numbered columns or the odd-numbered columnsof the display part to be in black display corresponding to theviewpoint of the viewpoint image data.
 11. A non-transitory computerreadable recording medium storing an image processing program forgenerating synthesized image data to be outputted to a display modulewhich includes: a display part in which sub-pixels connected to datalines via switching devices controlled by scanning lines are arranged inm-rows and n-columns (m and n are natural numbers), which is driven by(m+1) pieces of the scanning lines and at least n pieces of the datalines; and a first image separating device which directs light emittedfrom the sub-pixels towards a plurality of viewpoints in a sub-pixelunit; the program causing a compute to execute: a procedure for readingparameters showing a positional relation between the first imageseparating device and the display part from a parameter storage device;a procedure for inputting viewpoint image data for a plurality ofviewpoints from outside, and writing the data into the image memory; anda procedure for reading out the viewpoint image data from he imagememory according to a readout order that is obtained by applying theparameters to a repeating regulation that is determined based on layoutof the sub-pixels, number of colors, and layout of the colors, andoutputting the readout data to the display module as the synthesizedimage data, wherein: when the display part is formed by having anup-and-down sub-pixel pair that is formed with two of the sub-pixelsarranged by sandwiching one scanning line as a basic unit; the switchingdevices provided respectively to the two sub-pixels are controlled incommon by the scanning line sandwiched by the two sub-pixels, and areconnected to different data lines from each other; the up-and-downsub-pixel pairs neighboring to each other in an extending direction ofthe scanning lines are so disposed that the switching devices thereofare controlled by the different scanning lines from each other; thenumber of colors of the sub-pixels are three colors of a first color, asecond color, and a third color; provided that “y” is a natural number,one of the colors of two sub-pixels of the up-and-down sub-pixel pairconnected to y-th scanning line is the first color and the other coloris the second color, the pair forming either an even-numbered column oran odd-numbered column of the display part; one of the colors of twosub-pixels of the up-and-down sub-pixel pair connected to (y+1)-thscanning line is the second color and the other color is the thirdcolor, the pair forming the other one of the even-numbered column or theodd-numbered column of the display part; one of the colors of twosub-pixels of the up-and-down sub-pixel pair connected to (y+2)-thscanning line is the third color and the other color is the first color,the pair forming either an even-numbered column or an odd-numberedcolumn of the display part; one of the colors of two sub-pixels of theup-and-down sub-pixel pair connected to (y+3)-th scanning line is thefirst color and the other color is the second color, the pair formingthe other one of the even-numbered column or the odd-numbered column ofthe display part; one of the colors of two sub-pixels of the up-and-downsub-pixel pair connected to (y+4)-th scanning line is the second colorand the other color is the third color, the pair forming either aneven-numbered column or an odd-numbered column of the display part; oneof the colors of two sub-pixels of the up-and-down sub-pixel pairconnected to (y+5)-th scanning line is the third color and the othercolor is the first color, the pair forming the other one of theeven-numbered column or the odd-numbered column of the display part, theimage processing program causes the computer to execute the proceduresfor reading out the viewpoint image data from the image memory accordingto the readout order that is obtained by applying the parameters to therepeating regulation that is determined based on the layout of thesub-pixels, the number of colors, and the layout of the colors, andoutputting the readout data to the display module as the synthesizedimage data according to a following readout order of: reading out thefirst color and the second color by corresponding to the y-th scanningline, and reading out a viewpoint image which corresponds to one of theeven-numbered column or the odd-numbered column of the display part;reading out the second color and the third color by corresponding to the(y+1)-th scanning line, and reading out a viewpoint image whichcorresponds to the other one of the even-numbered column or theodd-numbered column of the display part; reading out the third color andthe first color by corresponding to the (y+2)-th scanning line, andreading out a viewpoint image which corresponds to one of theeven-numbered column or the odd-numbered column of the display part;reading out the first color and the second color by corresponding to the(y+3)-th scanning line, and reading out a viewpoint image whichcorresponds to the other one of the even-numbered column or theodd-numbered column of the display part; reading out the second colorand the third color by corresponding to the (y+4)-th scanning line, andreading out a viewpoint image which corresponds to one of theeven-numbered column or the odd-numbered column of the display part;reading out the third color and the first color by corresponding to the(y+5)-th scanning line, and reading out a viewpoint image whichcorresponds to the other one of the even-numbered column or theodd-numbered column of the display part.
 12. A display controller foroutputting synthesized image data to a display module which includes: adisplay part in which sub-pixels connected to data lines via switchingdevices controlled by scanning lines are arranged in m-rows andn-columns (m and n are natural numbers), which is driven by (m+1) piecesof the scanning lines and at least n pieces of the data lines; and afirst image separating device which directs light emitted from thesub-pixels towards a plurality of viewpoints in a sub-pixel unit; thedisplay controller comprising: an image memory which stores viewpointimage data for the plurality of viewpoints; a writing control devicewhich writes the viewpoint image data inputted from outside to the imagememory; a parameter storage device which stores parameters showing apositional relation between the first image separating device and thedisplay part; a readout control device which reads out the viewpointimage data from the image memory according to a readout order that isobtained by applying the parameters to a repeating regulation that isdetermined based on layout of the sub-pixels, number of colors, andlayout of the colors, and outputs the readout data to the display moduleas the synthesized image data; and an input data vertical-lateralconversion device which rearranges the viewpoint image data inputtedfrom outside into an image that is rotated by 90 degrees clockwise orcounterclockwise, wherein: the display module comprises a second imageseparating device formed with an electro-optic element, which directslight emitted from the sub-pixels towards a plurality of viewpoints inthe sub-pixel unit; a direction that connects the plurality ofviewpoints towards which the second image separating device directs thelight is orthogonal to a direction that connects the plurality ofviewpoints towards which the first image separating device directs thelight; and the writing control device has a function which writes theviewpoint image data that is rearranged by the input datavertical-lateral conversion device into the image memory, instead ofwriting the viewpoint image data inputted from outside.
 13. A displaycontroller for outputting synthesized image data to a display modulewhich includes: a display part in which sub-pixels connected to datalines via switching devices controlled by scanning lines are arranged inm-rows and n-columns (m and n are natural numbers), which is driven by(m+1) pieces of the scanning lines and at least n pieces of the datalines; and a first image separating device which directs light emittedfrom the sub-pixels towards a plurality of viewpoints in a sub-pixelunit; the display controller comprising: an image memory which storesviewpoint image data for the plurality of viewpoints; a writing controldevice which writes the viewpoint image data inputted from outside tothe image memory; a parameter storage device which stores parametersshowing a positional relation between he first image separating deviceand the display part; a readout control device which reads out theviewpoint image data from the image memory according to a readout orderthat is obtained by applying parameters to a repeating regulation thatis determined based on layout of the sub-pixels, number of colors, andlayout of the colors, and outputs the readout data to the display moduleas the synthesized image data; and an input data rearranging devicewhich rearranges the viewpoint mage data for four viewpoints or moreinputted from outside into the viewpoint image data for two viewpoints,wherein the writing control device has a function which writes theviewpoint image data that is rearranged by the input data rearrangingdevice into the image memory, instead of writing the viewpoint imagedata inputted from outside.